-- Logs begin at Tue 2022-05-17 14:49:33 UTC, end at Tue 2022-05-17 16:12:16 UTC. -- May 17 15:27:21.564377 dv-cinder-842128-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 17 15:27:21.572640 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 17 15:27:21.575320 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 15:27:21 2022] *** May 17 15:27:21.575465 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 15:27:21.575574 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 15:27:21.575677 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: nodename: dv-cinder-842128-1-iscsi May 17 15:27:21.575777 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: machine: x86_64 May 17 15:27:21.575990 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: clock source: unix May 17 15:27:21.576107 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: pcre jit disabled May 17 15:27:21.576207 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: detected number of CPU cores: 4 May 17 15:27:21.576306 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: current working directory: / May 17 15:27:21.576404 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: detected binary path: /usr/bin/uwsgi-core May 17 15:27:21.576507 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: your processes number limit is 47680 May 17 15:27:21.576607 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: your memory page size is 4096 bytes May 17 15:27:21.576727 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: detected max file descriptor number: 2048 May 17 15:27:21.576836 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: lock engine: pthread robust mutexes May 17 15:27:21.577089 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: thunder lock: enabled May 17 15:27:21.577371 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 17 15:27:21.577550 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 15:27:21.623390 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: Python main interpreter initialized at 0x5635981e79c0 May 17 15:27:21.623390 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: python threads support enabled May 17 15:27:21.623390 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: your server socket listen backlog is limited to 100 connections May 17 15:27:21.623390 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: your mercy for graceful operations on workers is 90 seconds May 17 15:27:21.623777 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: mapped 403077 bytes (393 KB) for 2 cores May 17 15:27:21.623854 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: *** Operational MODE: preforking *** May 17 15:27:21.624084 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: *** uWSGI is running in multiple interpreter mode *** May 17 15:27:21.624084 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: spawned uWSGI master process (pid: 80411) May 17 15:27:21.624295 dv-cinder-842128-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 17 15:27:21.627949 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: spawned uWSGI worker 1 (pid: 80423, cores: 1) May 17 15:27:21.627949 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: spawned uWSGI worker 2 (pid: 80424, cores: 1) May 17 15:27:21.627949 dv-cinder-842128-1-iscsi devstack@keystone.service[80411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 15:27:27.385429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:27:27.385429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: from cryptography.utils import int_from_bytes May 17 15:27:27.386766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:27:27.386766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: from cryptography.utils import int_from_bytes May 17 15:27:27.387243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:27:27.387243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: from cryptography.utils import int_from_bytes May 17 15:27:27.388568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:27:27.388568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: from cryptography.utils import int_from_bytes May 17 15:27:27.436361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 15:27:27.436486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 15:27:27.436668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] command line args: [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 15:27:27.436933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 15:27:27.437109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ================================================================================ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 15:27:27.437284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 15:27:27.437366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] admin_token = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.437500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 15:27:27.437578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] config_dir = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.437711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] command line args: [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 15:27:27.437795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.437937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] config_source = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.438043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 15:27:27.438117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ================================================================================ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 15:27:27.438181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] debug = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.438340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.440544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] admin_token = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.440544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config_dir = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.440668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.440731 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config_source = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] debug = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_config_append = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.441976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.442369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_dir = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.442559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.442793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.442962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.443190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.443350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_config_append = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.443535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.443725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.443913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.444105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_dir = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.444105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.444472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.444472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.444837 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.445029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.445228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.445422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.445618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.445811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.446031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.446148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.446254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.446254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.446461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.446575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.446654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.446772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.446856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447481 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447550 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.447932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] publish_errors = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448353 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] publish_errors = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] standard_threads = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] standard_threads = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.448963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_journal = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.449497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_json = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.449497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_stderr = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.449497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_syslog = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.449497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.449497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.449497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.449497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.449497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.449497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.450157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.450157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.450157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.450431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.450633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.450733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.450916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.451004 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.451135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.451223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.451292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_journal = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.451429 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.451506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_json = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.451630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.451713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_stderr = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.451856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] use_syslog = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.451918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.452076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:27:27.452161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.452309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.452400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.452573 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.452661 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.452805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.452888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.453055 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.453147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.453292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.453371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.453543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.453624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.453799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.453887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.454069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.454152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.454318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.454407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.454552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.454649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.454780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.454858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.455015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.455098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.455251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.455342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.455487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.455573 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.455731 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.455817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.455961 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.456050 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.456193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.456274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.456464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.456548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.457251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.457344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.457493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.457577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.457726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.457807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.457963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.458145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.458210 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.458267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.458451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.458540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.458682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.458780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.458910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.458986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.459140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.459221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.459367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.459456 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.459594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.459679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.459842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.459927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.460076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.460166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.460303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.460388 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.460519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.460595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.460756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.460842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.460993 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.461074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.461226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.461306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.461459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.461539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.461688 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.461774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.462022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.462123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.462197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.462399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.462635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.462923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.463125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.463313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.463313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.463672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.463927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.464123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.464308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.464557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.464759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.464982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.465177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.465367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.465608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.465799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.465992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.466253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.466442 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.466627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.466816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.467041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.467251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.467451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.467644 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.467792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.467967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.468097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.468224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.468386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.468522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.468650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.468778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.468904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.468904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.469183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.469329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.469457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.469589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.469717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.469843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.469977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.470144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.470280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.470443 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.470570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.470695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.470830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.470958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.471101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.471238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.471379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.471519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.471911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.472073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.472208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.472341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.472469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.472595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.472720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.472962 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.473137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.473269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.473412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.473412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.473653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.473787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.473921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.474093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.474240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.474369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.474504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.474640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.474767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.474893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.475019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.475155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.475282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.475417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.475545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.475670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.475796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.475921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.476055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.476191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.476191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.476448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.476575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.476707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.476834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.476970 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.477105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.external = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.477233 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.477360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.477486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.477613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.477740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.477874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.478017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.478150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.password = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.478276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.478402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.token = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.478528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.478665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.478803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.478929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.479055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.479181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.479306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.479444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.479573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.479699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.479826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.479951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.480077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.480211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.480339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.480504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.480643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.480780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.480914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.481042 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.481169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.481304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.481453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.481584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.481712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.481839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.481966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.482145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.482276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.482419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.482548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.482675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.482803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.external = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.482939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.483068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.483195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.483328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.483457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.483596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.483596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.password = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.483838 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.483974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.token = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.484114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.484243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.484381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.484509 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.484637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.484764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.484892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.485019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.485154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.485283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.485410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.485410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.485657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.485785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.485930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.486096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.486226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.486353 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.486480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.486623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.486763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.486895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.487029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.487157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.487285 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.487411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.487552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.487714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.487714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.487969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.488097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.488225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.488424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.488555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.488690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.488819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.488946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.489074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.489209 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.489338 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.489473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.489613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.489741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.489869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.490031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.490167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.490294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.490422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.490549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.490676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.490814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.490944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.491072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.491199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.491327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.491475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.491612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.491740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.491867 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.492001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.492130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.492259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.492394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.492524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.492651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.492778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.492905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.493032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.493178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.493307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.493434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.493561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.493688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.493823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.493952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.494100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.494230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.494357 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.494484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.494621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.494751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.494888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.495016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.495142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.495271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.495406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.495535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.495671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.495799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.495926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.496058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.496195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.496330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.496459 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.496587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.496725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.496852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.496988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.497123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.497260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.497390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.497517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.497645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.497782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.497911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.498063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.498198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.498326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.498455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.498604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.498735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.498863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.498991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.499118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.499246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.499381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.499511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.499639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.499766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.499894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.500021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.500157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.500299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.500427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.500556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.500683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.500811 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.500946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.501077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.501211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.501345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.501476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.501605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.501741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.501870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.502045 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.502191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.502319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.502448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.502586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.502723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.502852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.502988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.503117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.503245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.503903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.504032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.504160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.504287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.504414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.504552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.504689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.504825 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.504954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.505082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.505208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.505336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.505473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.505602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.505730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.505858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.505986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.506144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.506295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.506425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.506552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.506679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.506807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.506934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.507069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.507197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.507324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.507451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.507578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.507704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.507840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.507969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.508106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.508234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.508361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.508489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.508626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.508755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.508882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.509010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.509137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.509272 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.509401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.509528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.509655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.509781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.509918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.510121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.510257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.510384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.510511 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.510638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.510765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.510765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.511015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.511142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.511269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.511404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.511532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.511678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.511807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.511934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.512063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.512191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.512318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.512453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.512589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.512722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.512861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.512996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.513130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.513272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.513407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.513551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.513685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.513818 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.513952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.514180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.514319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.514453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.514587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.514721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.514854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.514996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.515132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.515267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.515400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.515544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.515679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.515822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.515958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.516092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.516226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.516361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.516496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.516643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.516779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.516913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.516913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.517166 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.517311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.517454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.517589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.517723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.517857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.517991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.518147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.518293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.518429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.518562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.518696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.518829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.519014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.519667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.519813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.519947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.520081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.520215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.520350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.520492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.520627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.520627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] role.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.520888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.521022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] role.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.521156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.521299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.521443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.521588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.521722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.521855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.522023 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.522165 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.522300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.522433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.522568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.522702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.522847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.522982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.523116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.523249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.523393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.523528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.523671 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.523806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.523939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.524073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.524207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.524340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.524482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.524617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.524752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.524885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.525019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.525019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.525288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.525424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.525557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.525691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.525824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.525958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.526125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.526262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.526395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.526529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.526670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.526804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.526946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.527092 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.527226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.527360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.527494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.527627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.527769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.527905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.528039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.528172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.528306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.528439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.528581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.528716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.528851 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.528994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.529129 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.529263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.529405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.529541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.529674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.529807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.529950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.530118 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.530240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.530372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.530500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.530625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.530763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.530888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.531015 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.531148 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.531274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.531400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.531524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.531649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.531773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.531905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.532032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.532156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.532281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.532405 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.532538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.532672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.532798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.532929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.533055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.533180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.533304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.533436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.533562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.533686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.533810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.533933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.534081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.534215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.534352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.534478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 15:27:27.535370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.535370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:27:27.536632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 15:27:27.556048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.556294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.556481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.560240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.560466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.560689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.565340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.569455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.598714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.599665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.599755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.599980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.656451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.658338 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.709109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.709275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.709730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.709966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.776871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.777127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.777240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.777313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.777378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.777554 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.777641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.777716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.777780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.777932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.778039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.778181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.802439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.802574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.802643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.802826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.802920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.802984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.803055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.803209 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.803289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.803418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.803498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.803636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.803716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.803854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.815037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.829838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.830094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.830181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.830312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.830392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.830520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.830615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.830752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.830834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.830974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.831054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.831126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.831189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.831336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 15:27:27.850209 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.850413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.850512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 15:27:27.850667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 15:27:27.850813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.851215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 15:27:27.851351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.851351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 15:27:27.851603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.851733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.851863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.851990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.852119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.852255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.852385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.852512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.863042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.863207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.863340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.863481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.863611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.863740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.863869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.863998 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.871935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.872086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.875219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.875376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.875506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.875647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.875866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.876003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.876133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.876262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.876417 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.876562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.876692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.876820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.876960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.877091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.877227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.877358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.877486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.877615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.877745 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.877882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.878034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.878171 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.904741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.905149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.906374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.906653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.906817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.907095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.912418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.912694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.912971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.913107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.913236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.913509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.921957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.921957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.922316 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.922316 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.925335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.925617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.925812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.925960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.926192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.926326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.926467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.926597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.926736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.926867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.926996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.927125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.927253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.927391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.927530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.927693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.945757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.946055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.946335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.946612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.951621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.952599 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.955317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.955618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.959613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.959863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.962038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.964830 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.965613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.968403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.969347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.969646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.969941 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.970253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.970532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.970811 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.972941 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.973235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.973562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.973843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.974140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.974419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.990638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.991013 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.991287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.991552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.993286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:27.993661 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.993932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.994222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:27.999431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.001167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.001445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.002085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.004084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.004358 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.004565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.004845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.005132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.005413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.005697 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.007572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.007852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.008130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.008414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.008705 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.019680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.019958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.020243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.020539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.020814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.021089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.021358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.022674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.022955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.023234 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.023523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.023800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.024078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.024347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.039918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.042898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.043225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.046157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.046549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.048148 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.049454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.049780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.051096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.051313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.051726 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.052725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.053218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.053365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.059546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.060694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.061315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.062323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.064695 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.065058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.065406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.065563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.065808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.065933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.066121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.066395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.075289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.075572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.075696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.075862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.076109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.076246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.084552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.084828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.084953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 15:27:28.085107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.085346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.085474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.085639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.085816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.085941 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.086231 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.086369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.086505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.086684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.086809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.087016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.087194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.087319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.087536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.087676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.087801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.087995 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.088157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.088391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.088727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.089063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.089408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.089751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.090109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 15:27:28.127577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5635981e79c0 pid: 80424 (default app) May 17 15:27:28.129580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5635981e79c0 pid: 80423 (default app) May 17 15:27:28.130973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac1684-ad8e-4b13-b78d-87bfeec897d4 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:28.131274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac1684-ad8e-4b13-b78d-87bfeec897d4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:28.131560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac1684-ad8e-4b13-b78d-87bfeec897d4 None None] PATH_INFO: `/v3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:28.135771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 791 bytes} [Tue May 17 15:27:28 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:36.108621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea287eb-daf2-4884-9b3e-62bdc8a89141 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:36.109190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea287eb-daf2-4884-9b3e-62bdc8a89141 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:36.109190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea287eb-daf2-4884-9b3e-62bdc8a89141 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:36.113751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1/2] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:27:36.118632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:36.119026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:36.119206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:36.150922 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG oslo_db.sqlalchemy.engines [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:27:36.336781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG passlib.handlers.bcrypt [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80424) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 15:27:36.337194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG passlib.handlers.bcrypt [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80424) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 15:27:36.392892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:36.394962 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:36.517180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 17 15:27:36.711487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea287eb-daf2-4884-9b3e-62bdc8a89141 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:36.744537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG oslo_db.sqlalchemy.engines [None req-dea287eb-daf2-4884-9b3e-62bdc8a89141 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:27:36.869426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea287eb-daf2-4884-9b3e-62bdc8a89141 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:36.873629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af1dda-33df-43d1-bf9f-0b32bf82dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:36.874323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af1dda-33df-43d1-bf9f-0b32bf82dc20 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:36.874600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af1dda-33df-43d1-bf9f-0b32bf82dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:36.874868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af1dda-33df-43d1-bf9f-0b32bf82dc20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:36.883600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af1dda-33df-43d1-bf9f-0b32bf82dc20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:36.935558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING keystone.common.rbac_enforcer.enforcer [None req-43af1dda-33df-43d1-bf9f-0b32bf82dc20 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 15:27:36.935894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af1dda-33df-43d1-bf9f-0b32bf82dc20 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:36.946247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1324 bytes} [Tue May 17 15:27:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 15:27:36.952139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:36.967271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424133bf-4a64-4faf-a8cc-aa343d86337d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:36.972617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa1485-331b-41ef-adf0-d68798c3508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:36.973741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa1485-331b-41ef-adf0-d68798c3508e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:36.974047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa1485-331b-41ef-adf0-d68798c3508e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:36.974334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa1485-331b-41ef-adf0-d68798c3508e admin admin] PATH_INFO: `/v3/projects/519a641cdee343408fe589d891a54066` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:36.975879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa1485-331b-41ef-adf0-d68798c3508e admin admin] RBAC: Authorizing `identity:get_project(project_id=519a641cdee343408fe589d891a54066)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:37.025677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e3aa1485-331b-41ef-adf0-d68798c3508e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 15:27:37.026029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa1485-331b-41ef-adf0-d68798c3508e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:37.030752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 3/5] 10.222.0.75 () {56 vars in 1207 bytes} [Tue May 17 15:27:36 2022] GET /identity/v3/projects/519a641cdee343408fe589d891a54066 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:39.288244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c120b7-ef94-4431-bbec-cf56d6f107a8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:39.288798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c120b7-ef94-4431-bbec-cf56d6f107a8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:39.288798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c120b7-ef94-4431-bbec-cf56d6f107a8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:39.293110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 3/6] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:39.299365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cde1-d478-4914-bc69-941ae9c1d9ba None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:39.300395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cde1-d478-4914-bc69-941ae9c1d9ba None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:39.300528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cde1-d478-4914-bc69-941ae9c1d9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:39.320984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8cf9cde1-d478-4914-bc69-941ae9c1d9ba None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:39.322536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8cf9cde1-d478-4914-bc69-941ae9c1d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:39.330310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 17 15:27:39.352411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c120b7-ef94-4431-bbec-cf56d6f107a8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:39.364820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c120b7-ef94-4431-bbec-cf56d6f107a8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:39.369168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0721e9-c2aa-4f4a-9f58-b0f2f95f428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:39.369802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0721e9-c2aa-4f4a-9f58-b0f2f95f428e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:39.370124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0721e9-c2aa-4f4a-9f58-b0f2f95f428e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:39.370402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0721e9-c2aa-4f4a-9f58-b0f2f95f428e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:39.378598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0721e9-c2aa-4f4a-9f58-b0f2f95f428e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:39.380360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0721e9-c2aa-4f4a-9f58-b0f2f95f428e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:39.388814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1324 bytes} [Tue May 17 15:27:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:27:39.394111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9cde1-d478-4914-bc69-941ae9c1d9ba None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:39.403009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9cde1-d478-4914-bc69-941ae9c1d9ba None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:39.407258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ebfee-6fa3-4590-8b73-1b608bf827d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:39.408108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ebfee-6fa3-4590-8b73-1b608bf827d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:39.408388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ebfee-6fa3-4590-8b73-1b608bf827d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:39.408662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ebfee-6fa3-4590-8b73-1b608bf827d0 admin admin] PATH_INFO: `/v3/users/2ee5e213008a431f98430b648aa9d659` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:39.410086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ebfee-6fa3-4590-8b73-1b608bf827d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ee5e213008a431f98430b648aa9d659)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:39.411907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ebfee-6fa3-4590-8b73-1b608bf827d0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:39.413444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 5/9] 10.222.0.75 () {56 vars in 1198 bytes} [Tue May 17 15:27:39 2022] GET /identity/v3/users/2ee5e213008a431f98430b648aa9d659 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:41.674827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404acb01-6e21-4667-9463-e48b4d754e55 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:41.675375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404acb01-6e21-4667-9463-e48b4d754e55 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:41.675375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404acb01-6e21-4667-9463-e48b4d754e55 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:41.676714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 5/10] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:41.681921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f95bd8-e736-42df-af97-a6ada9e201d6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:41.682361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f95bd8-e736-42df-af97-a6ada9e201d6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:41.682507 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f95bd8-e736-42df-af97-a6ada9e201d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:41.749758 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89245c38-d58b-423b-bd46-31dd8ce6ce67 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:41.750070 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89245c38-d58b-423b-bd46-31dd8ce6ce67 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:41.750350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89245c38-d58b-423b-bd46-31dd8ce6ce67 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:41.751713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 6/11] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:27:41.758173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959cdd-9e6b-4d87-8142-32c065656d68 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:41.758463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959cdd-9e6b-4d87-8142-32c065656d68 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:41.758742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959cdd-9e6b-4d87-8142-32c065656d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:41.799610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG passlib.handlers.bcrypt [None req-89959cdd-9e6b-4d87-8142-32c065656d68 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80423) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 15:27:41.800046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG passlib.handlers.bcrypt [None req-89959cdd-9e6b-4d87-8142-32c065656d68 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80423) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 15:27:41.808035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-85f95bd8-e736-42df-af97-a6ada9e201d6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:41.809244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-85f95bd8-e736-42df-af97-a6ada9e201d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:41.847258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-89959cdd-9e6b-4d87-8142-32c065656d68 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:41.848798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-89959cdd-9e6b-4d87-8142-32c065656d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:41.886931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 6/12] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:27:41.910336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f95bd8-e736-42df-af97-a6ada9e201d6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:41.945199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 7/13] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:27:41.967272 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89959cdd-9e6b-4d87-8142-32c065656d68 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:42.005013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f95bd8-e736-42df-af97-a6ada9e201d6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:42.036800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba84efd-9013-491a-a939-23ea5833d19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:42.037589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba84efd-9013-491a-a939-23ea5833d19f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:42.037877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba84efd-9013-491a-a939-23ea5833d19f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:42.038203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba84efd-9013-491a-a939-23ea5833d19f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:42.048957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba84efd-9013-491a-a939-23ea5833d19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:27:42.060524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89959cdd-9e6b-4d87-8142-32c065656d68 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7ba84efd-9013-491a-a939-23ea5833d19f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:27:42.060651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:27:42.061777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:27:42.062650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:27:42.066129 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 7/14] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:27:42.068084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba84efd-9013-491a-a939-23ea5833d19f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:42.093076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c1b7e-d9f1-4fc1-b9a2-d375cf77da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:42.093973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c1b7e-d9f1-4fc1-b9a2-d375cf77da7c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:42.094296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c1b7e-d9f1-4fc1-b9a2-d375cf77da7c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:42.094576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c1b7e-d9f1-4fc1-b9a2-d375cf77da7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:42.158259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c1b7e-d9f1-4fc1-b9a2-d375cf77da7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:42.159822 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c1b7e-d9f1-4fc1-b9a2-d375cf77da7c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:42.161613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba84efd-9013-491a-a939-23ea5833d19f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:42.193907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2817aa1-924c-4895-941f-6e3c5a6e7a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:42.194590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2817aa1-924c-4895-941f-6e3c5a6e7a19 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:42.194871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2817aa1-924c-4895-941f-6e3c5a6e7a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:42.195144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2817aa1-924c-4895-941f-6e3c5a6e7a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:42.195956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2817aa1-924c-4895-941f-6e3c5a6e7a19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:42.196235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2817aa1-924c-4895-941f-6e3c5a6e7a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:42.197620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2817aa1-924c-4895-941f-6e3c5a6e7a19 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:42.209040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 8/15] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:27:42.214393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2817aa1-924c-4895-941f-6e3c5a6e7a19 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:42.256723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 8/16] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 15:27:42.257766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c1b7e-d9f1-4fc1-b9a2-d375cf77da7c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:42.306994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2817aa1-924c-4895-941f-6e3c5a6e7a19 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:42.339495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a138f9-5046-4245-be48-ac1ecda13118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:42.340357 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a138f9-5046-4245-be48-ac1ecda13118 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:42.340632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a138f9-5046-4245-be48-ac1ecda13118 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:42.340899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a138f9-5046-4245-be48-ac1ecda13118 None admin] PATH_INFO: `/v3/users/2ee5e213008a431f98430b648aa9d659` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:42.342125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a138f9-5046-4245-be48-ac1ecda13118 None admin] RBAC: Authorizing `identity:get_user(user_id=2ee5e213008a431f98430b648aa9d659)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:42.343575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a138f9-5046-4245-be48-ac1ecda13118 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:42.345161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 9/17] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:27:42 2022] GET /identity/v3/users/2ee5e213008a431f98430b648aa9d659 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:27:42.350333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c1b7e-d9f1-4fc1-b9a2-d375cf77da7c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:42.350684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a138f9-5046-4245-be48-ac1ecda13118 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:42.382607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575d44a-f300-4f55-babd-a0dd9717339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:42.383396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575d44a-f300-4f55-babd-a0dd9717339b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:42.383683 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575d44a-f300-4f55-babd-a0dd9717339b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:42.383965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575d44a-f300-4f55-babd-a0dd9717339b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:42.448060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a138f9-5046-4245-be48-ac1ecda13118 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:42.482478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a09d8-1297-4da2-9cef-40125f60a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:42.483314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a09d8-1297-4da2-9cef-40125f60a591 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:42.483598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a09d8-1297-4da2-9cef-40125f60a591 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:42.483874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a09d8-1297-4da2-9cef-40125f60a591 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:42.485079 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a09d8-1297-4da2-9cef-40125f60a591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:42.486577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a09d8-1297-4da2-9cef-40125f60a591 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:42.488861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 10/18] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:27:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:27:42.494606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a09d8-1297-4da2-9cef-40125f60a591 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:42.508385 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575d44a-f300-4f55-babd-a0dd9717339b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:42.509849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575d44a-f300-4f55-babd-a0dd9717339b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b575d44a-f300-4f55-babd-a0dd9717339b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:27:42.530097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:27:42.531066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:27:42.531945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:27:42.531945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:27:42.531945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:27:42.531945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:27:42.531945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 9/19] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:27:42.537745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575d44a-f300-4f55-babd-a0dd9717339b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:42.591547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a09d8-1297-4da2-9cef-40125f60a591 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:42.623099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbf8d-9700-481d-a6e1-fc8128b4dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:42.623760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbf8d-9700-481d-a6e1-fc8128b4dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:42.624040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbf8d-9700-481d-a6e1-fc8128b4dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:42.624316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbf8d-9700-481d-a6e1-fc8128b4dbb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:42.625144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbf8d-9700-481d-a6e1-fc8128b4dbb5 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.domain.id=default, user.id=2ee5e213008a431f98430b648aa9d659) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:42.625453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbf8d-9700-481d-a6e1-fc8128b4dbb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:42.626934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbf8d-9700-481d-a6e1-fc8128b4dbb5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:42.633877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 11/20] 10.222.0.75 () {56 vars in 1322 bytes} [Tue May 17 15:27:42 2022] GET /identity/v3/role_assignments?user.id=2ee5e213008a431f98430b648aa9d659&scope.domain.id=default&role.id=cb77715547a14bae950f68513af00d30 => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:27:42.635339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575d44a-f300-4f55-babd-a0dd9717339b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:42.670611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcc791-c158-4a42-bee0-17ef28a5e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:42.671285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcc791-c158-4a42-bee0-17ef28a5e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:42.671572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcc791-c158-4a42-bee0-17ef28a5e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:42.671851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcc791-c158-4a42-bee0-17ef28a5e2d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:42.672600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcc791-c158-4a42-bee0-17ef28a5e2d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:42.672910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcc791-c158-4a42-bee0-17ef28a5e2d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:42.674435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcc791-c158-4a42-bee0-17ef28a5e2d2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:42.694034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 10/21] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:27:45.326049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e954f7-f100-4a81-aec1-a05a2ae8ff08 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:45.327092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e954f7-f100-4a81-aec1-a05a2ae8ff08 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:45.327624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e954f7-f100-4a81-aec1-a05a2ae8ff08 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:45.329579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 12/22] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:45.335466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bbebc-0f18-4d7e-9807-013c6b1454c0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:45.336331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bbebc-0f18-4d7e-9807-013c6b1454c0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:45.336843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bbebc-0f18-4d7e-9807-013c6b1454c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:45.355048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1e6bbebc-0f18-4d7e-9807-013c6b1454c0 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:45.356614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1e6bbebc-0f18-4d7e-9807-013c6b1454c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:45.428601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 11/23] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:45.462602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e954f7-f100-4a81-aec1-a05a2ae8ff08 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:45.514249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc21a2-49ec-48a6-9350-600c810294e4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:45.514878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc21a2-49ec-48a6-9350-600c810294e4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:45.515402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc21a2-49ec-48a6-9350-600c810294e4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:45.517196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 12/24] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:27:45.519016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fac24d-8b6b-4816-96cb-f4834da722d9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:45.519508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fac24d-8b6b-4816-96cb-f4834da722d9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:45.519968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fac24d-8b6b-4816-96cb-f4834da722d9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:45.521610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 13/25] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:45.526784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd6e0a-3eaf-468f-9a7b-2e3296d64261 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:45.527641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd6e0a-3eaf-468f-9a7b-2e3296d64261 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:45.528122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd6e0a-3eaf-468f-9a7b-2e3296d64261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:45.545336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0bcd6e0a-3eaf-468f-9a7b-2e3296d64261 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:45.546856 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0bcd6e0a-3eaf-468f-9a7b-2e3296d64261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:45.576224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e954f7-f100-4a81-aec1-a05a2ae8ff08 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:45.612787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b683db8-246f-4809-9df7-e0f6f8945713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:45.613588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b683db8-246f-4809-9df7-e0f6f8945713 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:45.613878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b683db8-246f-4809-9df7-e0f6f8945713 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:45.614191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b683db8-246f-4809-9df7-e0f6f8945713 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:45.620718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 14/26] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:27:45.622226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a6c63-67fd-4c29-a570-82d5ab8db4e9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:45.630021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a6c63-67fd-4c29-a570-82d5ab8db4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:45.630149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b683db8-246f-4809-9df7-e0f6f8945713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:27:45.630708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a6c63-67fd-4c29-a570-82d5ab8db4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5b683db8-246f-4809-9df7-e0f6f8945713 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:27:45.632990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:27:45.633814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:27:45.634603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:27:45.638111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 13/27] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:27:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:27:45.640083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b683db8-246f-4809-9df7-e0f6f8945713 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:45.655432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-313a6c63-67fd-4c29-a570-82d5ab8db4e9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:45.656612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-313a6c63-67fd-4c29-a570-82d5ab8db4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:45.746923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 15/28] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:45.748206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a6c63-67fd-4c29-a570-82d5ab8db4e9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:45.790674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b683db8-246f-4809-9df7-e0f6f8945713 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:45.840437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1d9ad-ad9e-471f-9aaf-3cb15d53a9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:45.841547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1d9ad-ad9e-471f-9aaf-3cb15d53a9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:45.842082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1d9ad-ad9e-471f-9aaf-3cb15d53a9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:45.842616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1d9ad-ad9e-471f-9aaf-3cb15d53a9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:45.843588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1d9ad-ad9e-471f-9aaf-3cb15d53a9b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:45.844090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1d9ad-ad9e-471f-9aaf-3cb15d53a9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:45.845724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1d9ad-ad9e-471f-9aaf-3cb15d53a9b8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:45.856020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 14/29] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:27:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:27:45.857553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1d9ad-ad9e-471f-9aaf-3cb15d53a9b8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:45.883989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a6c63-67fd-4c29-a570-82d5ab8db4e9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:45.933820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40670b-f2e4-4d88-84af-4c5d0d51df07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:45.934777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40670b-f2e4-4d88-84af-4c5d0d51df07 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:45.935208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40670b-f2e4-4d88-84af-4c5d0d51df07 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:45.935622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40670b-f2e4-4d88-84af-4c5d0d51df07 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:45.936554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40670b-f2e4-4d88-84af-4c5d0d51df07 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:45.938138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40670b-f2e4-4d88-84af-4c5d0d51df07 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:45.976411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1d9ad-ad9e-471f-9aaf-3cb15d53a9b8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:46.019355 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3df4-60e4-49b3-b3f1-353f61287b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:46.020566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3df4-60e4-49b3-b3f1-353f61287b47 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.021049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3df4-60e4-49b3-b3f1-353f61287b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.021530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3df4-60e4-49b3-b3f1-353f61287b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.047307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3df4-60e4-49b3-b3f1-353f61287b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:46.048807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3df4-60e4-49b3-b3f1-353f61287b47 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-018b3df4-60e4-49b3-b3f1-353f61287b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:27:46.072939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:27:46.073779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:27:46.074629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:27:46.074629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:27:46.074629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:27:46.074629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:27:46.090487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 15/30] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:27:46.091109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3df4-60e4-49b3-b3f1-353f61287b47 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:46.111091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 16/31] 10.222.0.75 () {60 vars in 1131 bytes} [Tue May 17 15:27:45 2022] POST /identity/v3/roles => generated 219 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:27:46.112194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40670b-f2e4-4d88-84af-4c5d0d51df07 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:46.316546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3df4-60e4-49b3-b3f1-353f61287b47 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:46.356225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40670b-f2e4-4d88-84af-4c5d0d51df07 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:46.387453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002796fa-f1a0-4756-ae1f-b51988813349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:46.388360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002796fa-f1a0-4756-ae1f-b51988813349 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.388646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002796fa-f1a0-4756-ae1f-b51988813349 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.388925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002796fa-f1a0-4756-ae1f-b51988813349 None admin] PATH_INFO: `/v3/users/2ee5e213008a431f98430b648aa9d659` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.394877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002796fa-f1a0-4756-ae1f-b51988813349 None admin] RBAC: Authorizing `identity:get_user(user_id=2ee5e213008a431f98430b648aa9d659)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:46.395471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4ebf-e59e-4fe7-8706-dc20186f61c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:46.396158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4ebf-e59e-4fe7-8706-dc20186f61c6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.396387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002796fa-f1a0-4756-ae1f-b51988813349 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:46.396486 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4ebf-e59e-4fe7-8706-dc20186f61c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.396704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4ebf-e59e-4fe7-8706-dc20186f61c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.397441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b4ebf-e59e-4fe7-8706-dc20186f61c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:46.397744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b4ebf-e59e-4fe7-8706-dc20186f61c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:46.398440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 16/32] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:27:46 2022] GET /identity/v3/users/2ee5e213008a431f98430b648aa9d659 => generated 247 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:46.399301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b4ebf-e59e-4fe7-8706-dc20186f61c6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:46.399743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebe74f-270d-47be-932d-3f0546e2c5d8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.400032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebe74f-270d-47be-932d-3f0546e2c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.400314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebe74f-270d-47be-932d-3f0546e2c5d8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.401950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 17/33] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:46.406149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebe74f-270d-47be-932d-3f0546e2c5d8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:46.419301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 17/34] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:46.420784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1637330-3560-46e3-a240-fafabc9de573 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.421075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1637330-3560-46e3-a240-fafabc9de573 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.421351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1637330-3560-46e3-a240-fafabc9de573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.438049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f1637330-3560-46e3-a240-fafabc9de573 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:46.439780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f1637330-3560-46e3-a240-fafabc9de573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:46.510278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 18/35] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:46.511408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1637330-3560-46e3-a240-fafabc9de573 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:46.520487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebe74f-270d-47be-932d-3f0546e2c5d8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:46.569109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cec18-e69b-43e2-8b6a-6f13cfda3fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:46.569830 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cec18-e69b-43e2-8b6a-6f13cfda3fcd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.570319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cec18-e69b-43e2-8b6a-6f13cfda3fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.570730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cec18-e69b-43e2-8b6a-6f13cfda3fcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.572045 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cec18-e69b-43e2-8b6a-6f13cfda3fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:46.573631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cec18-e69b-43e2-8b6a-6f13cfda3fcd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:46.575800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 18/36] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:27:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:46.576711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cec18-e69b-43e2-8b6a-6f13cfda3fcd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:46.637710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1637330-3560-46e3-a240-fafabc9de573 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:46.677832 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c8454-d5f1-4b37-9338-5c3b61ec8f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:46.678531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8454-d5f1-4b37-9338-5c3b61ec8f46 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.678819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8454-d5f1-4b37-9338-5c3b61ec8f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.679097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8454-d5f1-4b37-9338-5c3b61ec8f46 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.680219 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c8454-d5f1-4b37-9338-5c3b61ec8f46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:46.681619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c8454-d5f1-4b37-9338-5c3b61ec8f46 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:46.688640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cec18-e69b-43e2-8b6a-6f13cfda3fcd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:46.722384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 19/37] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:27:46 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:27:46.723814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf349b-854c-4613-a8ab-90521139cd58 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.724113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf349b-854c-4613-a8ab-90521139cd58 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.724396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf349b-854c-4613-a8ab-90521139cd58 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.725881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 20/38] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:46.726518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf349b-854c-4613-a8ab-90521139cd58 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:46.730200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61701a-cd1a-4f97-b769-2609e7dc7320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:46.730937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61701a-cd1a-4f97-b769-2609e7dc7320 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.731218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61701a-cd1a-4f97-b769-2609e7dc7320 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.731491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61701a-cd1a-4f97-b769-2609e7dc7320 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.732245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61701a-cd1a-4f97-b769-2609e7dc7320 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:46.733651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61701a-cd1a-4f97-b769-2609e7dc7320 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:46.849567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf349b-854c-4613-a8ab-90521139cd58 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:46.887892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe8b62-1f97-41a7-88f7-41808e3348da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:46.889150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe8b62-1f97-41a7-88f7-41808e3348da None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.889636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe8b62-1f97-41a7-88f7-41808e3348da None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.890296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe8b62-1f97-41a7-88f7-41808e3348da None admin] PATH_INFO: `/v3/domains/default/users/2ee5e213008a431f98430b648aa9d659/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.892604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1131 bytes} [Tue May 17 15:27:46 2022] POST /identity/v3/roles => generated 225 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:27:46.893940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe8b62-1f97-41a7-88f7-41808e3348da None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2ee5e213008a431f98430b648aa9d659, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:46.894880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683380db-a70a-4d6b-96cf-bb3a060355b8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:46.895168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683380db-a70a-4d6b-96cf-bb3a060355b8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:46.895447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683380db-a70a-4d6b-96cf-bb3a060355b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:46.896436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe8b62-1f97-41a7-88f7-41808e3348da None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:46.917832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-683380db-a70a-4d6b-96cf-bb3a060355b8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:46.919484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-683380db-a70a-4d6b-96cf-bb3a060355b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:46.927908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 21/40] 10.222.0.75 () {58 vars in 1361 bytes} [Tue May 17 15:27:46 2022] PUT /identity/v3/domains/default/users/2ee5e213008a431f98430b648aa9d659/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:27:47.019906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 20/41] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:47.044713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe8b62-1f97-41a7-88f7-41808e3348da None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:47.168804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe8b62-1f97-41a7-88f7-41808e3348da None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:47.205508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019681cc-1091-4424-a992-146b7aa8c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:47.206772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019681cc-1091-4424-a992-146b7aa8c441 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:47.207055 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019681cc-1091-4424-a992-146b7aa8c441 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:47.207331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019681cc-1091-4424-a992-146b7aa8c441 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:47.208073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019681cc-1091-4424-a992-146b7aa8c441 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:47.209456 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019681cc-1091-4424-a992-146b7aa8c441 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:47.223996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1131 bytes} [Tue May 17 15:27:47 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:27:47.295186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661abe3-5d65-45d1-ab46-97cd475e9b24 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:47.295476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661abe3-5d65-45d1-ab46-97cd475e9b24 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:47.295764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661abe3-5d65-45d1-ab46-97cd475e9b24 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:47.297173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 21/43] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:47.303458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02171b52-670a-4b69-a7b6-ff329902b9f8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:47.303761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02171b52-670a-4b69-a7b6-ff329902b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:47.304068 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02171b52-670a-4b69-a7b6-ff329902b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:47.323018 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-02171b52-670a-4b69-a7b6-ff329902b9f8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:47.324253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-02171b52-670a-4b69-a7b6-ff329902b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:47.394254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 23/44] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:47.416618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661abe3-5d65-45d1-ab46-97cd475e9b24 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:47.519381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661abe3-5d65-45d1-ab46-97cd475e9b24 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:47.551303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fbc08-a16a-482e-9701-ead5f15708e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:47.552089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbc08-a16a-482e-9701-ead5f15708e8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:47.552376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbc08-a16a-482e-9701-ead5f15708e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:47.552653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbc08-a16a-482e-9701-ead5f15708e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:47.553828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fbc08-a16a-482e-9701-ead5f15708e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:47.555449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fbc08-a16a-482e-9701-ead5f15708e8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:47.557224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 22/45] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:27:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:47.562617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02171b52-670a-4b69-a7b6-ff329902b9f8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:47.656767 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02171b52-670a-4b69-a7b6-ff329902b9f8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:47.688530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da945f1e-513d-40ea-a405-ad83e83a4a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:47.689107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da945f1e-513d-40ea-a405-ad83e83a4a39 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:47.689387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da945f1e-513d-40ea-a405-ad83e83a4a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:47.689661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da945f1e-513d-40ea-a405-ad83e83a4a39 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:47.690933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da945f1e-513d-40ea-a405-ad83e83a4a39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:47.692369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da945f1e-513d-40ea-a405-ad83e83a4a39 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:47.716203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:27:47 2022] POST /identity/v3/projects => generated 312 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:27:49.238997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a0007-b053-4ae6-b022-4ca06bb45c40 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:49.239490 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a0007-b053-4ae6-b022-4ca06bb45c40 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:49.239570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a0007-b053-4ae6-b022-4ca06bb45c40 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:49.240900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 23/47] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:49.246080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44995adf-e565-4dc9-8649-64416d74f7c3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:49.246488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44995adf-e565-4dc9-8649-64416d74f7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:49.246631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44995adf-e565-4dc9-8649-64416d74f7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:49.263422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-44995adf-e565-4dc9-8649-64416d74f7c3 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:49.264623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44995adf-e565-4dc9-8649-64416d74f7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:49.329162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 25/48] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:49.353305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a0007-b053-4ae6-b022-4ca06bb45c40 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:49.449582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a0007-b053-4ae6-b022-4ca06bb45c40 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:49.481867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d18fe8-d8da-44d8-ac90-c0f32021bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:49.482688 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d18fe8-d8da-44d8-ac90-c0f32021bdfc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:49.482977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d18fe8-d8da-44d8-ac90-c0f32021bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:49.483256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d18fe8-d8da-44d8-ac90-c0f32021bdfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:49.493851 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d18fe8-d8da-44d8-ac90-c0f32021bdfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a8d18fe8-d8da-44d8-ac90-c0f32021bdfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:27:49.501488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:27:49.502420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:27:49.503158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 24/49] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:27:49.508453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44995adf-e565-4dc9-8649-64416d74f7c3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:49.603449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44995adf-e565-4dc9-8649-64416d74f7c3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:49.634009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a7206-600f-45ca-8d85-0fbe5cb2703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:49.634684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a7206-600f-45ca-8d85-0fbe5cb2703f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:49.634965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a7206-600f-45ca-8d85-0fbe5cb2703f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:49.635237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a7206-600f-45ca-8d85-0fbe5cb2703f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:49.635973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a7206-600f-45ca-8d85-0fbe5cb2703f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:49.636275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a7206-600f-45ca-8d85-0fbe5cb2703f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:49.637646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a7206-600f-45ca-8d85-0fbe5cb2703f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:49.648988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 26/50] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:49.654491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d18fe8-d8da-44d8-ac90-c0f32021bdfc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:49.748189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d18fe8-d8da-44d8-ac90-c0f32021bdfc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:49.782701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd47c22-1505-4053-adaa-c2d2288b52c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:49.783638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd47c22-1505-4053-adaa-c2d2288b52c7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:49.784425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd47c22-1505-4053-adaa-c2d2288b52c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:49.784700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd47c22-1505-4053-adaa-c2d2288b52c7 None admin] PATH_INFO: `/v3/users/2ee5e213008a431f98430b648aa9d659` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:49.785881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd47c22-1505-4053-adaa-c2d2288b52c7 None admin] RBAC: Authorizing `identity:get_user(user_id=2ee5e213008a431f98430b648aa9d659)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:49.787358 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd47c22-1505-4053-adaa-c2d2288b52c7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:49.788990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 25/51] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:27:49 2022] GET /identity/v3/users/2ee5e213008a431f98430b648aa9d659 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:27:49.794482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a7206-600f-45ca-8d85-0fbe5cb2703f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:49.887916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a7206-600f-45ca-8d85-0fbe5cb2703f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:49.919842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f27cad-b20f-47b9-bc41-f3746e744ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:49.920623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f27cad-b20f-47b9-bc41-f3746e744ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:49.920900 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f27cad-b20f-47b9-bc41-f3746e744ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:49.921172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f27cad-b20f-47b9-bc41-f3746e744ce5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:49.922356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f27cad-b20f-47b9-bc41-f3746e744ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:49.923780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f27cad-b20f-47b9-bc41-f3746e744ce5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:49.925401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 27/52] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:27:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:49.931151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd47c22-1505-4053-adaa-c2d2288b52c7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:49.933858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec580-f4c8-4c44-a1ad-509c600b7619 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:49.934174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec580-f4c8-4c44-a1ad-509c600b7619 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:49.934450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec580-f4c8-4c44-a1ad-509c600b7619 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:49.935700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 28/53] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:27:49.941093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34308-0db0-45f8-99f3-6b69e80c8d35 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:49.941379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34308-0db0-45f8-99f3-6b69e80c8d35 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:49.941655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34308-0db0-45f8-99f3-6b69e80c8d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:49.957762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-05a34308-0db0-45f8-99f3-6b69e80c8d35 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:49.958964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-05a34308-0db0-45f8-99f3-6b69e80c8d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:50.020692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 29/54] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:27:50.025704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd47c22-1505-4053-adaa-c2d2288b52c7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:50.042999 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34308-0db0-45f8-99f3-6b69e80c8d35 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:50.056274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f13c0-471a-41db-9450-602ac735b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:50.056916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f13c0-471a-41db-9450-602ac735b9cd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:50.057198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f13c0-471a-41db-9450-602ac735b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:50.057472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f13c0-471a-41db-9450-602ac735b9cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:50.058322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f13c0-471a-41db-9450-602ac735b9cd None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.domain.id=default, user.id=2ee5e213008a431f98430b648aa9d659) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:50.058628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f13c0-471a-41db-9450-602ac735b9cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:50.060072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f13c0-471a-41db-9450-602ac735b9cd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:50.066146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 26/55] 10.222.0.75 () {56 vars in 1322 bytes} [Tue May 17 15:27:49 2022] GET /identity/v3/role_assignments?user.id=2ee5e213008a431f98430b648aa9d659&scope.domain.id=default&role.id=cb77715547a14bae950f68513af00d30 => generated 530 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:50.140702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34308-0db0-45f8-99f3-6b69e80c8d35 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:50.175452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d202a-73bb-4989-be44-0b682e3b7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:50.176258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d202a-73bb-4989-be44-0b682e3b7594 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:50.176545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d202a-73bb-4989-be44-0b682e3b7594 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:50.176823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d202a-73bb-4989-be44-0b682e3b7594 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:50.178120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d202a-73bb-4989-be44-0b682e3b7594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:50.179533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d202a-73bb-4989-be44-0b682e3b7594 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:50.181200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 30/56] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:27:50.191370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f13c0-471a-41db-9450-602ac735b9cd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:50.290998 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f13c0-471a-41db-9450-602ac735b9cd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:50.324324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e529c-d294-415d-83f4-240ddf09ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:50.324984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e529c-d294-415d-83f4-240ddf09ec7a None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:50.325272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e529c-d294-415d-83f4-240ddf09ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:50.325553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e529c-d294-415d-83f4-240ddf09ec7a None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:50.326289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e529c-d294-415d-83f4-240ddf09ec7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:50.327741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e529c-d294-415d-83f4-240ddf09ec7a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:50.355733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 27/57] 10.222.0.75 () {60 vars in 1140 bytes} [Tue May 17 15:27:50 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:27:52.543289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990000-6ca3-4698-bb93-d6b7b0ca8d9b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:52.543793 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990000-6ca3-4698-bb93-d6b7b0ca8d9b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:52.543793 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990000-6ca3-4698-bb93-d6b7b0ca8d9b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:52.545121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 31/58] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:52.550884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42fd74-20d1-454f-b86d-3677145e7834 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:52.551257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42fd74-20d1-454f-b86d-3677145e7834 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:52.551437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42fd74-20d1-454f-b86d-3677145e7834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:52.567997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7b42fd74-20d1-454f-b86d-3677145e7834 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:52.569187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7b42fd74-20d1-454f-b86d-3677145e7834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:52.633847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 28/59] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:52.657729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe990000-6ca3-4698-bb93-d6b7b0ca8d9b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:52.752369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe990000-6ca3-4698-bb93-d6b7b0ca8d9b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:52.784047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737444-a9d4-490d-9d88-c7f5cfbc8b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:52.784825 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737444-a9d4-490d-9d88-c7f5cfbc8b84 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:52.785106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737444-a9d4-490d-9d88-c7f5cfbc8b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:52.785381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737444-a9d4-490d-9d88-c7f5cfbc8b84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:52.786565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba737444-a9d4-490d-9d88-c7f5cfbc8b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:52.788019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba737444-a9d4-490d-9d88-c7f5cfbc8b84 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:52.789597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 32/60] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:27:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:52.795111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42fd74-20d1-454f-b86d-3677145e7834 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:52.886780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42fd74-20d1-454f-b86d-3677145e7834 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:52.918753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c62bf-ee43-4615-9df8-8878842bc20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:52.919413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c62bf-ee43-4615-9df8-8878842bc20a None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:52.919698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c62bf-ee43-4615-9df8-8878842bc20a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:52.919977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c62bf-ee43-4615-9df8-8878842bc20a None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:52.920674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c62bf-ee43-4615-9df8-8878842bc20a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:52.922142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c62bf-ee43-4615-9df8-8878842bc20a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:52.946379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 29/61] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:27:52 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:27:56.275891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86029b4c-0670-44ce-828e-9edd4744960a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.276908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86029b4c-0670-44ce-828e-9edd4744960a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.277392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86029b4c-0670-44ce-828e-9edd4744960a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.279051 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 33/62] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:56.285157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2619937-34c4-4362-ab86-068b3ca433f1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.286087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2619937-34c4-4362-ab86-068b3ca433f1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.286582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2619937-34c4-4362-ab86-068b3ca433f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.310292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f2619937-34c4-4362-ab86-068b3ca433f1 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:56.311807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f2619937-34c4-4362-ab86-068b3ca433f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:56.396404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 30/63] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:56.419488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86029b4c-0670-44ce-828e-9edd4744960a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:56.447149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c2a05-32f8-4725-b9dd-1090d85c3f31 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.447928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c2a05-32f8-4725-b9dd-1090d85c3f31 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.449668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c2a05-32f8-4725-b9dd-1090d85c3f31 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.452074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 31/64] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:56.454151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2320c-b50d-4b30-8fd1-01b8fe89d17d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.454446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2320c-b50d-4b30-8fd1-01b8fe89d17d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.454732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2320c-b50d-4b30-8fd1-01b8fe89d17d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.456037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 32/65] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:27:56.461291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b82a2b-d60d-42c6-8877-a43e68c533d5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.461806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b82a2b-d60d-42c6-8877-a43e68c533d5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.462335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b82a2b-d60d-42c6-8877-a43e68c533d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.479452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f6b82a2b-d60d-42c6-8877-a43e68c533d5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:56.480953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f6b82a2b-d60d-42c6-8877-a43e68c533d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:56.545590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86029b4c-0670-44ce-828e-9edd4744960a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:56.547903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 33/66] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:27:56.558140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3215-d4df-4290-9a6d-c85156b28b1f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.558900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3215-d4df-4290-9a6d-c85156b28b1f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.559379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3215-d4df-4290-9a6d-c85156b28b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.586926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34277088-0f1b-483d-9af3-3bcb3ea22297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:56.587995 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34277088-0f1b-483d-9af3-3bcb3ea22297 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.588261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-62bc3215-d4df-4290-9a6d-c85156b28b1f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:56.588607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34277088-0f1b-483d-9af3-3bcb3ea22297 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.589052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34277088-0f1b-483d-9af3-3bcb3ea22297 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.589816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-62bc3215-d4df-4290-9a6d-c85156b28b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:56.603935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34277088-0f1b-483d-9af3-3bcb3ea22297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-34277088-0f1b-483d-9af3-3bcb3ea22297 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:27:56.617348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:27:56.618488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:27:56.619431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:27:56.621902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 34/67] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:27:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:27:56.622952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34277088-0f1b-483d-9af3-3bcb3ea22297 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:56.662857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 34/68] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:56.664083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc3215-d4df-4290-9a6d-c85156b28b1f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:56.747129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34277088-0f1b-483d-9af3-3bcb3ea22297 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:56.765360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc3215-d4df-4290-9a6d-c85156b28b1f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:56.785626 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7568446-1e3f-4bf2-8b97-bfaba50e5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:56.786732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7568446-1e3f-4bf2-8b97-bfaba50e5041 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.787020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7568446-1e3f-4bf2-8b97-bfaba50e5041 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.787459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7568446-1e3f-4bf2-8b97-bfaba50e5041 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.797921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c416b-fe6b-4dee-9e95-30a4d23abaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:56.798630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c416b-fe6b-4dee-9e95-30a4d23abaee None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.799004 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c416b-fe6b-4dee-9e95-30a4d23abaee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.799772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c416b-fe6b-4dee-9e95-30a4d23abaee None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.799862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7568446-1e3f-4bf2-8b97-bfaba50e5041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:27:56.800511 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c416b-fe6b-4dee-9e95-30a4d23abaee None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:56.800815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c416b-fe6b-4dee-9e95-30a4d23abaee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:56.802219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c416b-fe6b-4dee-9e95-30a4d23abaee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f7568446-1e3f-4bf2-8b97-bfaba50e5041 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:27:56.809117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:27:56.809949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:27:56.810981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 35/69] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:27:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:27:56.812212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7568446-1e3f-4bf2-8b97-bfaba50e5041 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:56.814922 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 35/70] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:27:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:56.816296 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8a1ce-0bd0-48c9-84b0-c9015df02b67 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.816584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8a1ce-0bd0-48c9-84b0-c9015df02b67 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.817071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8a1ce-0bd0-48c9-84b0-c9015df02b67 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.818538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 36/71] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:56.819094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8a1ce-0bd0-48c9-84b0-c9015df02b67 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:56.921145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8a1ce-0bd0-48c9-84b0-c9015df02b67 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:56.925091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7568446-1e3f-4bf2-8b97-bfaba50e5041 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:56.953577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07d219-0973-4cde-aa7a-2c33de5e66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:56.954477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07d219-0973-4cde-aa7a-2c33de5e66df None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.954753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07d219-0973-4cde-aa7a-2c33de5e66df None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.955034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07d219-0973-4cde-aa7a-2c33de5e66df None admin] PATH_INFO: `/v3/users/d63543b997cd4d44b3f069a642b26186` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.960703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de298d4-3f2c-4049-88c9-e44244f36bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:56.961489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de298d4-3f2c-4049-88c9-e44244f36bce None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.961772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de298d4-3f2c-4049-88c9-e44244f36bce None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.962076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de298d4-3f2c-4049-88c9-e44244f36bce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:56.968910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07d219-0973-4cde-aa7a-2c33de5e66df None admin] RBAC: Authorizing `identity:get_user(user_id=d63543b997cd4d44b3f069a642b26186)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:56.971195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07d219-0973-4cde-aa7a-2c33de5e66df None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:56.977864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 37/72] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:27:56 2022] GET /identity/v3/users/d63543b997cd4d44b3f069a642b26186 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:56.977864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07d219-0973-4cde-aa7a-2c33de5e66df None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:56.979432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de298d4-3f2c-4049-88c9-e44244f36bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4de298d4-3f2c-4049-88c9-e44244f36bce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:27:56.987932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:27:56.988881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:27:56.989647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 36/73] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:27:56.991350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d88fc-9c56-4a5f-88a4-1fd896f091d1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:56.991350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d88fc-9c56-4a5f-88a4-1fd896f091d1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:56.991670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d88fc-9c56-4a5f-88a4-1fd896f091d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.008595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a19d88fc-9c56-4a5f-88a4-1fd896f091d1 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:57.009781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a19d88fc-9c56-4a5f-88a4-1fd896f091d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:57.084941 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07d219-0973-4cde-aa7a-2c33de5e66df None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.086299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 37/74] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:57.088225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d88fc-9c56-4a5f-88a4-1fd896f091d1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:57.119385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8aebbf-ed28-469b-b1bb-ad366948c9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.120064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8aebbf-ed28-469b-b1bb-ad366948c9af None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.120348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8aebbf-ed28-469b-b1bb-ad366948c9af None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.120857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8aebbf-ed28-469b-b1bb-ad366948c9af None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.121365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8aebbf-ed28-469b-b1bb-ad366948c9af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:57.121674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8aebbf-ed28-469b-b1bb-ad366948c9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:57.123099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8aebbf-ed28-469b-b1bb-ad366948c9af None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:57.135726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 38/75] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:27:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:57.135726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8aebbf-ed28-469b-b1bb-ad366948c9af None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:57.197845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d88fc-9c56-4a5f-88a4-1fd896f091d1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.229779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8aebbf-ed28-469b-b1bb-ad366948c9af None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.230508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7c71c-39bf-48d6-935c-8f7da54ffe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.231172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7c71c-39bf-48d6-935c-8f7da54ffe94 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.231455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7c71c-39bf-48d6-935c-8f7da54ffe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.231736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7c71c-39bf-48d6-935c-8f7da54ffe94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.262190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326511e5-bf57-4239-9237-f0aad3d01e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.262850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326511e5-bf57-4239-9237-f0aad3d01e3f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.263136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326511e5-bf57-4239-9237-f0aad3d01e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.263412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326511e5-bf57-4239-9237-f0aad3d01e3f None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.264154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326511e5-bf57-4239-9237-f0aad3d01e3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:57.264454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326511e5-bf57-4239-9237-f0aad3d01e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:57.265881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326511e5-bf57-4239-9237-f0aad3d01e3f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:57.274236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 39/76] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:57.275925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326511e5-bf57-4239-9237-f0aad3d01e3f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:57.296191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7c71c-39bf-48d6-935c-8f7da54ffe94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:57.297649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7c71c-39bf-48d6-935c-8f7da54ffe94 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:57.371738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326511e5-bf57-4239-9237-f0aad3d01e3f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.389443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 38/77] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:27:57.390297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7c71c-39bf-48d6-935c-8f7da54ffe94 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:57.404093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf30036-9650-47e6-919f-1ee76557e52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.404889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf30036-9650-47e6-919f-1ee76557e52e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.405182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf30036-9650-47e6-919f-1ee76557e52e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.405460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf30036-9650-47e6-919f-1ee76557e52e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.415814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf30036-9650-47e6-919f-1ee76557e52e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ddf30036-9650-47e6-919f-1ee76557e52e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:27:57.423406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:27:57.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:27:57.425106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 40/78] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:27:57.426144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d152f-b50a-48b0-91ae-11bef7115789 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.426144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d152f-b50a-48b0-91ae-11bef7115789 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.426352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d152f-b50a-48b0-91ae-11bef7115789 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.427789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 41/79] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:27:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:27:57.428303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d152f-b50a-48b0-91ae-11bef7115789 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:57.485457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7c71c-39bf-48d6-935c-8f7da54ffe94 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.516665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bffe21-789a-4a4f-b0dd-a0f8a58a521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.517525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bffe21-789a-4a4f-b0dd-a0f8a58a521c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.518376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bffe21-789a-4a4f-b0dd-a0f8a58a521c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.518653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bffe21-789a-4a4f-b0dd-a0f8a58a521c None admin] PATH_INFO: `/v3/users/d63543b997cd4d44b3f069a642b26186` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.519924 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bffe21-789a-4a4f-b0dd-a0f8a58a521c None admin] RBAC: Authorizing `identity:get_user(user_id=d63543b997cd4d44b3f069a642b26186)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:57.521367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bffe21-789a-4a4f-b0dd-a0f8a58a521c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:57.523174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 39/80] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/users/d63543b997cd4d44b3f069a642b26186 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:57.523839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bffe21-789a-4a4f-b0dd-a0f8a58a521c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:57.525597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d152f-b50a-48b0-91ae-11bef7115789 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.557204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b759-024b-4dd6-832d-58dae16ade5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.558089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b759-024b-4dd6-832d-58dae16ade5d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.558385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b759-024b-4dd6-832d-58dae16ade5d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.558668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b759-024b-4dd6-832d-58dae16ade5d None admin] PATH_INFO: `/v3/users/2ee5e213008a431f98430b648aa9d659` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.559834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17b759-024b-4dd6-832d-58dae16ade5d None admin] RBAC: Authorizing `identity:get_user(user_id=2ee5e213008a431f98430b648aa9d659)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:57.561292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17b759-024b-4dd6-832d-58dae16ade5d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:57.562946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 42/81] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/users/2ee5e213008a431f98430b648aa9d659 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:57.563708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b759-024b-4dd6-832d-58dae16ade5d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:57.618207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bffe21-789a-4a4f-b0dd-a0f8a58a521c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.650418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff859c0-0f96-4932-b080-cc2fb0aa6209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.651271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff859c0-0f96-4932-b080-cc2fb0aa6209 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.651563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff859c0-0f96-4932-b080-cc2fb0aa6209 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.651845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff859c0-0f96-4932-b080-cc2fb0aa6209 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.653046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff859c0-0f96-4932-b080-cc2fb0aa6209 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:57.654536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff859c0-0f96-4932-b080-cc2fb0aa6209 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:57.656230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 40/82] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:57.657227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b759-024b-4dd6-832d-58dae16ade5d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.657397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaedaf0-e295-404a-add8-6495d67edd7b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.657641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaedaf0-e295-404a-add8-6495d67edd7b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.657922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaedaf0-e295-404a-add8-6495d67edd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.674016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-abaedaf0-e295-404a-add8-6495d67edd7b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:27:57.675491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-abaedaf0-e295-404a-add8-6495d67edd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:27:57.688556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07a451-0ff7-458e-9872-8a11b95ddded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.689226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07a451-0ff7-458e-9872-8a11b95ddded None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.690421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07a451-0ff7-458e-9872-8a11b95ddded None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.690706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07a451-0ff7-458e-9872-8a11b95ddded None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.691446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07a451-0ff7-458e-9872-8a11b95ddded None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:57.691749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07a451-0ff7-458e-9872-8a11b95ddded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:57.693156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07a451-0ff7-458e-9872-8a11b95ddded None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:57.700986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 43/83] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:57.701850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07a451-0ff7-458e-9872-8a11b95ddded None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:57.738126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 41/84] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:27:57.738882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaedaf0-e295-404a-add8-6495d67edd7b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:57.795706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07a451-0ff7-458e-9872-8a11b95ddded None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.827727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3722873-ceed-44cd-b3a5-7a4fc40b081d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.828375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3722873-ceed-44cd-b3a5-7a4fc40b081d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.828662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3722873-ceed-44cd-b3a5-7a4fc40b081d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.828948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3722873-ceed-44cd-b3a5-7a4fc40b081d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.831071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaedaf0-e295-404a-add8-6495d67edd7b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:57.862979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359611-6bbc-4c57-83d7-09953b927722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:57.863614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359611-6bbc-4c57-83d7-09953b927722 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:57.863896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359611-6bbc-4c57-83d7-09953b927722 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:57.864168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359611-6bbc-4c57-83d7-09953b927722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:57.893394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3722873-ceed-44cd-b3a5-7a4fc40b081d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:57.895140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3722873-ceed-44cd-b3a5-7a4fc40b081d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:57.927136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359611-6bbc-4c57-83d7-09953b927722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:57.928584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359611-6bbc-4c57-83d7-09953b927722 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:57.992961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 44/85] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:27:57.992961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3722873-ceed-44cd-b3a5-7a4fc40b081d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.020688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 42/86] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:27:58.021744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359611-6bbc-4c57-83d7-09953b927722 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.083477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3722873-ceed-44cd-b3a5-7a4fc40b081d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.112434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359611-6bbc-4c57-83d7-09953b927722 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.114666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec8283-06b2-46ad-93bb-f89a30cc0495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.115316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec8283-06b2-46ad-93bb-f89a30cc0495 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.115595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec8283-06b2-46ad-93bb-f89a30cc0495 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.115867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec8283-06b2-46ad-93bb-f89a30cc0495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.116687 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec8283-06b2-46ad-93bb-f89a30cc0495 None admin] RBAC: Adding query filter params (role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=40b91b4949b0461a99311b62cd96aa7a, user.id=d63543b997cd4d44b3f069a642b26186) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:58.116994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec8283-06b2-46ad-93bb-f89a30cc0495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec8283-06b2-46ad-93bb-f89a30cc0495 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.123594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 45/87] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:27:57 2022] GET /identity/v3/role_assignments?user.id=d63543b997cd4d44b3f069a642b26186&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:58.124346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec8283-06b2-46ad-93bb-f89a30cc0495 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.148418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c397-2cb7-4cd8-8a0a-e8783353c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.149361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c397-2cb7-4cd8-8a0a-e8783353c72a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.149649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c397-2cb7-4cd8-8a0a-e8783353c72a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.149922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c397-2cb7-4cd8-8a0a-e8783353c72a None admin] PATH_INFO: `/v3/users/d63543b997cd4d44b3f069a642b26186` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.151255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51c397-2cb7-4cd8-8a0a-e8783353c72a None admin] RBAC: Authorizing `identity:get_user(user_id=d63543b997cd4d44b3f069a642b26186)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.152822 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51c397-2cb7-4cd8-8a0a-e8783353c72a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.154956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 43/88] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:27:58 2022] GET /identity/v3/users/d63543b997cd4d44b3f069a642b26186 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:58.155789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c397-2cb7-4cd8-8a0a-e8783353c72a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.240579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec8283-06b2-46ad-93bb-f89a30cc0495 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.260283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c397-2cb7-4cd8-8a0a-e8783353c72a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.276971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff2669-05b2-4419-bdf6-6437119d022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.277783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff2669-05b2-4419-bdf6-6437119d022f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.278100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff2669-05b2-4419-bdf6-6437119d022f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.278374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff2669-05b2-4419-bdf6-6437119d022f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.279590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff2669-05b2-4419-bdf6-6437119d022f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.281073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff2669-05b2-4419-bdf6-6437119d022f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.282995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 46/89] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:58.283605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff2669-05b2-4419-bdf6-6437119d022f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.298388 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4d004-857b-4a69-a14a-393846e002eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.299304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d004-857b-4a69-a14a-393846e002eb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.299590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d004-857b-4a69-a14a-393846e002eb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.299866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d004-857b-4a69-a14a-393846e002eb None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.301099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4d004-857b-4a69-a14a-393846e002eb None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.302578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4d004-857b-4a69-a14a-393846e002eb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.305854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 44/90] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:27:58 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:58.305854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4d004-857b-4a69-a14a-393846e002eb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.387572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff2669-05b2-4419-bdf6-6437119d022f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.413058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4d004-857b-4a69-a14a-393846e002eb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.423755 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea8351-d798-4e80-a10f-1280d377efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.424646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea8351-d798-4e80-a10f-1280d377efb0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.424929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea8351-d798-4e80-a10f-1280d377efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.425204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea8351-d798-4e80-a10f-1280d377efb0 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.426597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea8351-d798-4e80-a10f-1280d377efb0 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.427866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea8351-d798-4e80-a10f-1280d377efb0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.434771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 47/91] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:27:58 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:58.434771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea8351-d798-4e80-a10f-1280d377efb0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.445487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44f47-c1d9-485b-bec6-dc41417428db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.446166 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44f47-c1d9-485b-bec6-dc41417428db None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.446450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44f47-c1d9-485b-bec6-dc41417428db None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.446726 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44f47-c1d9-485b-bec6-dc41417428db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.512078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca44f47-c1d9-485b-bec6-dc41417428db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.513826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca44f47-c1d9-485b-bec6-dc41417428db None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.529450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea8351-d798-4e80-a10f-1280d377efb0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.561600 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83ac7-a723-451b-ad1c-63ceeb29f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.562443 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83ac7-a723-451b-ad1c-63ceeb29f752 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.562571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83ac7-a723-451b-ad1c-63ceeb29f752 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.562838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83ac7-a723-451b-ad1c-63ceeb29f752 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.563538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec83ac7-a723-451b-ad1c-63ceeb29f752 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.565580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec83ac7-a723-451b-ad1c-63ceeb29f752 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.585298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 48/92] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:27:58 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:27:58.586302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83ac7-a723-451b-ad1c-63ceeb29f752 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.616930 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 45/93] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:27:58.618160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44f47-c1d9-485b-bec6-dc41417428db None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.711223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83ac7-a723-451b-ad1c-63ceeb29f752 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.724743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44f47-c1d9-485b-bec6-dc41417428db None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.747190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c194-1162-45ef-abe3-7a21e355026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.747956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c194-1162-45ef-abe3-7a21e355026d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.748387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c194-1162-45ef-abe3-7a21e355026d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.748660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c194-1162-45ef-abe3-7a21e355026d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.749583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c194-1162-45ef-abe3-7a21e355026d None admin] RBAC: Adding query filter params (role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=40b91b4949b0461a99311b62cd96aa7a, user.id=d63543b997cd4d44b3f069a642b26186) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:58.750027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c194-1162-45ef-abe3-7a21e355026d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.751708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c194-1162-45ef-abe3-7a21e355026d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.758645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 49/94] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:27:58 2022] GET /identity/v3/role_assignments?user.id=d63543b997cd4d44b3f069a642b26186&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:58.759406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c194-1162-45ef-abe3-7a21e355026d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:58.763692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e6bfe-595e-45e6-a5ef-0be742b3d0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.764620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e6bfe-595e-45e6-a5ef-0be742b3d0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.765092 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e6bfe-595e-45e6-a5ef-0be742b3d0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.765627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e6bfe-595e-45e6-a5ef-0be742b3d0a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.766700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e6bfe-595e-45e6-a5ef-0be742b3d0a7 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=40b91b4949b0461a99311b62cd96aa7a, user.id=2ee5e213008a431f98430b648aa9d659) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:58.767199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e6bfe-595e-45e6-a5ef-0be742b3d0a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.768946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e6bfe-595e-45e6-a5ef-0be742b3d0a7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.786247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 46/95] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:27:58 2022] GET /identity/v3/role_assignments?user.id=2ee5e213008a431f98430b648aa9d659&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=cb77715547a14bae950f68513af00d30 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:58.920692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c194-1162-45ef-abe3-7a21e355026d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:58.962610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c931b-298d-4e5e-b3fa-eeedefa1320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:58.963974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c931b-298d-4e5e-b3fa-eeedefa1320b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:58.964504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c931b-298d-4e5e-b3fa-eeedefa1320b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:58.964979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c931b-298d-4e5e-b3fa-eeedefa1320b None admin] PATH_INFO: `/v3/projects/4adbd6e7240147dfa810260856ebdf7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:58.967095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c931b-298d-4e5e-b3fa-eeedefa1320b None admin] RBAC: Authorizing `identity:get_project(project_id=4adbd6e7240147dfa810260856ebdf7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:58.968847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c931b-298d-4e5e-b3fa-eeedefa1320b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:58.971651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 50/96] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:27:58 2022] GET /identity/v3/projects/4adbd6e7240147dfa810260856ebdf7a => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:27:58.977243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e6bfe-595e-45e6-a5ef-0be742b3d0a7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:27:59.083751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e6bfe-595e-45e6-a5ef-0be742b3d0a7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:27:59.117955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fc4f1-9994-4e17-9ed4-61bedb5bebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:27:59.118969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc4f1-9994-4e17-9ed4-61bedb5bebab None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:27:59.119469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc4f1-9994-4e17-9ed4-61bedb5bebab None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:27:59.119934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc4f1-9994-4e17-9ed4-61bedb5bebab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:27:59.120974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fc4f1-9994-4e17-9ed4-61bedb5bebab None admin] RBAC: Adding query filter params (role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=4adbd6e7240147dfa810260856ebdf7a, user.id=d63543b997cd4d44b3f069a642b26186) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:27:59.121481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fc4f1-9994-4e17-9ed4-61bedb5bebab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:27:59.123168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fc4f1-9994-4e17-9ed4-61bedb5bebab None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:27:59.130140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 47/97] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:27:58 2022] GET /identity/v3/role_assignments?user.id=d63543b997cd4d44b3f069a642b26186&scope.project.id=4adbd6e7240147dfa810260856ebdf7a&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:00.595767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a4c4d-1a8d-410c-b76e-8f35992b6056 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:00.596287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a4c4d-1a8d-410c-b76e-8f35992b6056 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:00.596287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a4c4d-1a8d-410c-b76e-8f35992b6056 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:00.597855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 51/98] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:00.614389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff0cdf-ba39-4e22-9e2b-f1bc8118849f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:00.614801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff0cdf-ba39-4e22-9e2b-f1bc8118849f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:00.614985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff0cdf-ba39-4e22-9e2b-f1bc8118849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:00.638955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a1ff0cdf-ba39-4e22-9e2b-f1bc8118849f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:00.640162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a1ff0cdf-ba39-4e22-9e2b-f1bc8118849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:00.722469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 48/99] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:00.763752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a4c4d-1a8d-410c-b76e-8f35992b6056 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:00.888996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a4c4d-1a8d-410c-b76e-8f35992b6056 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:00.929544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508adf2f-2e2c-4680-942d-9e93d9fd73b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:00.930375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508adf2f-2e2c-4680-942d-9e93d9fd73b5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:00.930662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508adf2f-2e2c-4680-942d-9e93d9fd73b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:00.930941 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508adf2f-2e2c-4680-942d-9e93d9fd73b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:00.947002 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508adf2f-2e2c-4680-942d-9e93d9fd73b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-508adf2f-2e2c-4680-942d-9e93d9fd73b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:00.954779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:00.956202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:00.956977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 52/100] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:00.962517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff0cdf-ba39-4e22-9e2b-f1bc8118849f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:01.084996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff0cdf-ba39-4e22-9e2b-f1bc8118849f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:01.129396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e6149-fb88-4129-b3c4-25c2cfabcc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:01.130099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e6149-fb88-4129-b3c4-25c2cfabcc6a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:01.130383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e6149-fb88-4129-b3c4-25c2cfabcc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:01.130665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e6149-fb88-4129-b3c4-25c2cfabcc6a None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:01.131423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e6149-fb88-4129-b3c4-25c2cfabcc6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:01.131730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e6149-fb88-4129-b3c4-25c2cfabcc6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:01.133105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e6149-fb88-4129-b3c4-25c2cfabcc6a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:01.151241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 49/101] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:01.156997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508adf2f-2e2c-4680-942d-9e93d9fd73b5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:01.322457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508adf2f-2e2c-4680-942d-9e93d9fd73b5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:01.371218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f777319-882b-4ad0-84ae-adacfcbc7b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:01.372502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777319-882b-4ad0-84ae-adacfcbc7b6e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:01.372994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777319-882b-4ad0-84ae-adacfcbc7b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:01.373473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777319-882b-4ad0-84ae-adacfcbc7b6e None admin] PATH_INFO: `/v3/users/d63543b997cd4d44b3f069a642b26186` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:01.374995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777319-882b-4ad0-84ae-adacfcbc7b6e None admin] RBAC: Authorizing `identity:get_user(user_id=d63543b997cd4d44b3f069a642b26186)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:01.376693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777319-882b-4ad0-84ae-adacfcbc7b6e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:01.379130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 53/102] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:01 2022] GET /identity/v3/users/d63543b997cd4d44b3f069a642b26186 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:01.384742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e6149-fb88-4129-b3c4-25c2cfabcc6a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:01.531050 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e6149-fb88-4129-b3c4-25c2cfabcc6a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:01.575991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2a2c4-fedf-40d5-8540-73b67a5884ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:01.576911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2a2c4-fedf-40d5-8540-73b67a5884ca None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:01.577202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2a2c4-fedf-40d5-8540-73b67a5884ca None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:01.577366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fad04-68f3-49eb-ad65-c3ba7060a371 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:01.577503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2a2c4-fedf-40d5-8540-73b67a5884ca None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:01.578110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fad04-68f3-49eb-ad65-c3ba7060a371 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:01.578623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fad04-68f3-49eb-ad65-c3ba7060a371 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:01.579506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2a2c4-fedf-40d5-8540-73b67a5884ca None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:01.580369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 54/103] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:01.581069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2a2c4-fedf-40d5-8540-73b67a5884ca None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:01.581886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f32834-c882-4761-b0eb-fc88f0cf5ad9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:01.582403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f32834-c882-4761-b0eb-fc88f0cf5ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:01.582990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 50/104] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:01 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:01.583300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f32834-c882-4761-b0eb-fc88f0cf5ad9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:01.584736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 55/105] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:01.588801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2a2c4-fedf-40d5-8540-73b67a5884ca None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:01.590318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ea22a-1ca6-4893-a2b3-b1b339e28def None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:01.590832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ea22a-1ca6-4893-a2b3-b1b339e28def None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:01.591322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ea22a-1ca6-4893-a2b3-b1b339e28def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:01.613250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a46ea22a-1ca6-4893-a2b3-b1b339e28def None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:01.615248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a46ea22a-1ca6-4893-a2b3-b1b339e28def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:01.684660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 56/106] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:01.694374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45489-7011-4275-a32a-c4f0e8d6c864 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:01.694916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45489-7011-4275-a32a-c4f0e8d6c864 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:01.695408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45489-7011-4275-a32a-c4f0e8d6c864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:01.719380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2a2c4-fedf-40d5-8540-73b67a5884ca None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:01.730261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-56b45489-7011-4275-a32a-c4f0e8d6c864 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:01.731477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-56b45489-7011-4275-a32a-c4f0e8d6c864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:01.763296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742701a-1a82-4aee-9ca0-228de0cd660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:01.764590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742701a-1a82-4aee-9ca0-228de0cd660d None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:01.765076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742701a-1a82-4aee-9ca0-228de0cd660d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:01.765647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742701a-1a82-4aee-9ca0-228de0cd660d None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a/users/d63543b997cd4d44b3f069a642b26186/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:01.771394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742701a-1a82-4aee-9ca0-228de0cd660d None admin] RBAC: Authorizing `identity:create_grant(project_id=40b91b4949b0461a99311b62cd96aa7a, user_id=d63543b997cd4d44b3f069a642b26186, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:01.773121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742701a-1a82-4aee-9ca0-228de0cd660d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:01.801370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 51/107] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:28:01 2022] PUT /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a/users/d63543b997cd4d44b3f069a642b26186/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:01.801892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742701a-1a82-4aee-9ca0-228de0cd660d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:01.827614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 57/108] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:01.917544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45489-7011-4275-a32a-c4f0e8d6c864 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:01.979885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742701a-1a82-4aee-9ca0-228de0cd660d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:02.036105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c372e-25b2-4601-b682-8fac8598d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:02.037096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c372e-25b2-4601-b682-8fac8598d213 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:02.037758 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c372e-25b2-4601-b682-8fac8598d213 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:02.038072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c372e-25b2-4601-b682-8fac8598d213 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:02.052177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c372e-25b2-4601-b682-8fac8598d213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ed8c372e-25b2-4601-b682-8fac8598d213 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:02.061230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:02.062158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:02.063361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 52/109] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:02.070449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c372e-25b2-4601-b682-8fac8598d213 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:02.138517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45489-7011-4275-a32a-c4f0e8d6c864 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:02.213278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d52d25-2bd0-483f-ad6d-80fb8fc27c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:02.214109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d52d25-2bd0-483f-ad6d-80fb8fc27c0f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:02.214395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d52d25-2bd0-483f-ad6d-80fb8fc27c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:02.214671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d52d25-2bd0-483f-ad6d-80fb8fc27c0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:02.235146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d52d25-2bd0-483f-ad6d-80fb8fc27c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-14d52d25-2bd0-483f-ad6d-80fb8fc27c0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:02.245700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:02.246627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:02.247843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 58/110] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:02.256228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c372e-25b2-4601-b682-8fac8598d213 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:02.263297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d52d25-2bd0-483f-ad6d-80fb8fc27c0f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:02.341505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6922834-d393-495a-b9f9-21ceb4f5163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:02.342452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922834-d393-495a-b9f9-21ceb4f5163a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:02.342870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922834-d393-495a-b9f9-21ceb4f5163a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:02.343273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922834-d393-495a-b9f9-21ceb4f5163a None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:02.344178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6922834-d393-495a-b9f9-21ceb4f5163a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:02.344615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6922834-d393-495a-b9f9-21ceb4f5163a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:02.346215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6922834-d393-495a-b9f9-21ceb4f5163a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:02.365126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 53/111] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:02.371255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6922834-d393-495a-b9f9-21ceb4f5163a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:02.457493 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d52d25-2bd0-483f-ad6d-80fb8fc27c0f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:02.543797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94490780-4dea-4445-9579-8f3a73705d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:02.544722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94490780-4dea-4445-9579-8f3a73705d66 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:02.545167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94490780-4dea-4445-9579-8f3a73705d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:02.545579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94490780-4dea-4445-9579-8f3a73705d66 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:02.546510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94490780-4dea-4445-9579-8f3a73705d66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:02.546965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94490780-4dea-4445-9579-8f3a73705d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:02.548516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94490780-4dea-4445-9579-8f3a73705d66 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:02.565429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 59/112] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:02.572575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94490780-4dea-4445-9579-8f3a73705d66 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:02.577764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6922834-d393-495a-b9f9-21ceb4f5163a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:02.632154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5fb7-1593-48d6-959d-d58b94277a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:02.633654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5fb7-1593-48d6-959d-d58b94277a5e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:02.635510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5fb7-1593-48d6-959d-d58b94277a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:02.636270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5fb7-1593-48d6-959d-d58b94277a5e None admin] PATH_INFO: `/v3/users/d63543b997cd4d44b3f069a642b26186` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:02.639775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab5fb7-1593-48d6-959d-d58b94277a5e None admin] RBAC: Authorizing `identity:get_user(user_id=d63543b997cd4d44b3f069a642b26186)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:02.643771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab5fb7-1593-48d6-959d-d58b94277a5e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:02.647820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 54/113] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:02 2022] GET /identity/v3/users/d63543b997cd4d44b3f069a642b26186 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:02.653983 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5fb7-1593-48d6-959d-d58b94277a5e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:02.736892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94490780-4dea-4445-9579-8f3a73705d66 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:02.773205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f03a7-8999-4122-88dc-049febfa1ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:02.774615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f03a7-8999-4122-88dc-049febfa1ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:02.775221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f03a7-8999-4122-88dc-049febfa1ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:02.776005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f03a7-8999-4122-88dc-049febfa1ed2 None admin] PATH_INFO: `/v3/users/2ee5e213008a431f98430b648aa9d659` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:02.777797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f03a7-8999-4122-88dc-049febfa1ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=2ee5e213008a431f98430b648aa9d659)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:02.780079 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f03a7-8999-4122-88dc-049febfa1ed2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:02.781264 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5fb7-1593-48d6-959d-d58b94277a5e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:02.782273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 60/114] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:02 2022] GET /identity/v3/users/2ee5e213008a431f98430b648aa9d659 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:02.791624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f03a7-8999-4122-88dc-049febfa1ed2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:02.833132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9da1a0-edac-4d38-8e75-45d939265158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:02.834431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9da1a0-edac-4d38-8e75-45d939265158 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:02.834884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9da1a0-edac-4d38-8e75-45d939265158 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:02.835318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9da1a0-edac-4d38-8e75-45d939265158 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:02.837121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9da1a0-edac-4d38-8e75-45d939265158 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:02.838801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9da1a0-edac-4d38-8e75-45d939265158 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:02.843165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 55/115] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:02 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:02.849882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9da1a0-edac-4d38-8e75-45d939265158 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:02.978248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f03a7-8999-4122-88dc-049febfa1ed2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:02.995653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9da1a0-edac-4d38-8e75-45d939265158 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:03.019725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513beff-b05a-4998-be1c-a1447fc21b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:03.021139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513beff-b05a-4998-be1c-a1447fc21b5f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.021499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513beff-b05a-4998-be1c-a1447fc21b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.022021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513beff-b05a-4998-be1c-a1447fc21b5f None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.023666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513beff-b05a-4998-be1c-a1447fc21b5f None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:03.026202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513beff-b05a-4998-be1c-a1447fc21b5f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:03.029202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 61/116] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:02 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:03.030278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c25f-dd40-4b6d-a79f-4fcd775ed86e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.030571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c25f-dd40-4b6d-a79f-4fcd775ed86e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.030907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c25f-dd40-4b6d-a79f-4fcd775ed86e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.032292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 62/117] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:03.033458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c3f2-7971-413b-a206-4cec4336a52c None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.034154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c3f2-7971-413b-a206-4cec4336a52c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.034438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c3f2-7971-413b-a206-4cec4336a52c None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.036327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 63/118] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:03.036881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c3f2-7971-413b-a206-4cec4336a52c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:03.041791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376554c1-29ff-4278-96aa-4573f3059b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:03.042718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376554c1-29ff-4278-96aa-4573f3059b68 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.043007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376554c1-29ff-4278-96aa-4573f3059b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.043286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376554c1-29ff-4278-96aa-4573f3059b68 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a/users/d63543b997cd4d44b3f069a642b26186/roles/552d2ed1429f43ac91cee158ee03be96` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.045520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376554c1-29ff-4278-96aa-4573f3059b68 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b91b4949b0461a99311b62cd96aa7a, user_id=d63543b997cd4d44b3f069a642b26186, role_id=552d2ed1429f43ac91cee158ee03be96)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:03.047024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376554c1-29ff-4278-96aa-4573f3059b68 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:03.070251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 56/119] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:28:02 2022] PUT /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a/users/d63543b997cd4d44b3f069a642b26186/roles/552d2ed1429f43ac91cee158ee03be96 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:03.070251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca34cd-8144-4409-8510-7c20e0d8d4a8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.070251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca34cd-8144-4409-8510-7c20e0d8d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.070251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca34cd-8144-4409-8510-7c20e0d8d4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.086342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-85ca34cd-8144-4409-8510-7c20e0d8d4a8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:03.087650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-85ca34cd-8144-4409-8510-7c20e0d8d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:03.168997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c3f2-7971-413b-a206-4cec4336a52c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:03.181220 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 57/120] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:03.183485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72c2f-98b1-4623-82c8-5c0fb272ac5e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.184005 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72c2f-98b1-4623-82c8-5c0fb272ac5e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.184879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72c2f-98b1-4623-82c8-5c0fb272ac5e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.186932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 58/121] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:03.191931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463db3c-14c4-46d0-bcf5-4000af574f00 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.191931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463db3c-14c4-46d0-bcf5-4000af574f00 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.192160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463db3c-14c4-46d0-bcf5-4000af574f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.211782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbefb6d-ec26-4a29-bdc8-c3a48c59f7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:03.212751 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbefb6d-ec26-4a29-bdc8-c3a48c59f7a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.213097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbefb6d-ec26-4a29-bdc8-c3a48c59f7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.213377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbefb6d-ec26-4a29-bdc8-c3a48c59f7a9 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a/users/2ee5e213008a431f98430b648aa9d659/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.214912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6463db3c-14c4-46d0-bcf5-4000af574f00 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:03.215557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbefb6d-ec26-4a29-bdc8-c3a48c59f7a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b91b4949b0461a99311b62cd96aa7a, user_id=2ee5e213008a431f98430b648aa9d659, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:03.216639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6463db3c-14c4-46d0-bcf5-4000af574f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:03.217167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbefb6d-ec26-4a29-bdc8-c3a48c59f7a9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:03.234347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 64/122] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:28:03 2022] PUT /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a/users/2ee5e213008a431f98430b648aa9d659/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:03.235774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0875c-d912-45bb-9eb5-ad38ce50ca58 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.236692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0875c-d912-45bb-9eb5-ad38ce50ca58 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.236985 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0875c-d912-45bb-9eb5-ad38ce50ca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.256088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-83d0875c-d912-45bb-9eb5-ad38ce50ca58 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:03.257435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-83d0875c-d912-45bb-9eb5-ad38ce50ca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:03.298421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 59/123] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:03.299656 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463db3c-14c4-46d0-bcf5-4000af574f00 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:03.341946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 65/124] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:03.342865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0875c-d912-45bb-9eb5-ad38ce50ca58 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:03.440542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463db3c-14c4-46d0-bcf5-4000af574f00 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:03.488174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6560-7b86-465b-95a2-0dfac13f17a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:03.488722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0875c-d912-45bb-9eb5-ad38ce50ca58 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:03.489622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6560-7b86-465b-95a2-0dfac13f17a3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.490124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6560-7b86-465b-95a2-0dfac13f17a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.490754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6560-7b86-465b-95a2-0dfac13f17a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.508267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af6560-7b86-465b-95a2-0dfac13f17a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a1af6560-7b86-465b-95a2-0dfac13f17a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:03.519099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:03.519971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:03.520727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:03.523200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 60/125] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:03.524607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6560-7b86-465b-95a2-0dfac13f17a3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:03.527622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7c23-9a8a-4322-94a2-cda6d6529aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:03.528601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7c23-9a8a-4322-94a2-cda6d6529aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.530132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7c23-9a8a-4322-94a2-cda6d6529aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.530525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7c23-9a8a-4322-94a2-cda6d6529aa5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.531866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b7c23-9a8a-4322-94a2-cda6d6529aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:03.534201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b7c23-9a8a-4322-94a2-cda6d6529aa5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:03.536088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 66/126] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:03.536996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7c23-9a8a-4322-94a2-cda6d6529aa5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:03.639725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6560-7b86-465b-95a2-0dfac13f17a3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:03.646353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7c23-9a8a-4322-94a2-cda6d6529aa5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:03.673486 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfc236-ba24-47f0-ac29-186e57798bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:03.675203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc236-ba24-47f0-ac29-186e57798bce None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.675684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc236-ba24-47f0-ac29-186e57798bce None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.676176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc236-ba24-47f0-ac29-186e57798bce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.682253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a2b91-44a2-4db7-a205-49a53200b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:03.682930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a2b91-44a2-4db7-a205-49a53200b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.683219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a2b91-44a2-4db7-a205-49a53200b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.683495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a2b91-44a2-4db7-a205-49a53200b0d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.684242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a2b91-44a2-4db7-a205-49a53200b0d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:03.684551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a2b91-44a2-4db7-a205-49a53200b0d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:03.686023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a2b91-44a2-4db7-a205-49a53200b0d6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:03.688743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfc236-ba24-47f0-ac29-186e57798bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:03.695183 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 67/127] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:03.695991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a2b91-44a2-4db7-a205-49a53200b0d6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-96bfc236-ba24-47f0-ac29-186e57798bce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:03.698031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:03.698876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:03.699638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:03.702193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 61/128] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:03.703159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfc236-ba24-47f0-ac29-186e57798bce None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:03.797879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a2b91-44a2-4db7-a205-49a53200b0d6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:03.846986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84b7cf-c576-45e9-bbdd-37181d5724a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:03.847671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84b7cf-c576-45e9-bbdd-37181d5724a6 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.847960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84b7cf-c576-45e9-bbdd-37181d5724a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.848243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84b7cf-c576-45e9-bbdd-37181d5724a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.848988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84b7cf-c576-45e9-bbdd-37181d5724a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:03.854609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84b7cf-c576-45e9-bbdd-37181d5724a6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:03.885519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfc236-ba24-47f0-ac29-186e57798bce None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:03.902087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 68/129] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:28:03 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:03.903000 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84b7cf-c576-45e9-bbdd-37181d5724a6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:03.956682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b1352-14b2-4c77-bcbe-48b52c43dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:03.957587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1352-14b2-4c77-bcbe-48b52c43dc61 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:03.957870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1352-14b2-4c77-bcbe-48b52c43dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:03.958886 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1352-14b2-4c77-bcbe-48b52c43dc61 None admin] PATH_INFO: `/v3/users/d63543b997cd4d44b3f069a642b26186` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:03.960969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1352-14b2-4c77-bcbe-48b52c43dc61 None admin] RBAC: Authorizing `identity:get_user(user_id=d63543b997cd4d44b3f069a642b26186)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:03.962506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1352-14b2-4c77-bcbe-48b52c43dc61 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:03.964385 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 62/130] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:03 2022] GET /identity/v3/users/d63543b997cd4d44b3f069a642b26186 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:03.970191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b1352-14b2-4c77-bcbe-48b52c43dc61 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:04.104248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84b7cf-c576-45e9-bbdd-37181d5724a6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:04.168299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b1352-14b2-4c77-bcbe-48b52c43dc61 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:04.183880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0adb76-765d-456b-8667-4339ed03cc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:04.184932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0adb76-765d-456b-8667-4339ed03cc43 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:04.186916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0adb76-765d-456b-8667-4339ed03cc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:04.187413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0adb76-765d-456b-8667-4339ed03cc43 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:04.188446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0adb76-765d-456b-8667-4339ed03cc43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:04.190694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0adb76-765d-456b-8667-4339ed03cc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:04.194246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0adb76-765d-456b-8667-4339ed03cc43 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:04.214315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 69/131] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:04.240475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0adb76-765d-456b-8667-4339ed03cc43 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:04.244558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524e0c-d2e3-4202-a429-9746817e76e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:04.249874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524e0c-d2e3-4202-a429-9746817e76e6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:04.252594 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524e0c-d2e3-4202-a429-9746817e76e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:04.254213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524e0c-d2e3-4202-a429-9746817e76e6 None admin] PATH_INFO: `/v3/projects/4adbd6e7240147dfa810260856ebdf7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:04.255835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8524e0c-d2e3-4202-a429-9746817e76e6 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbd6e7240147dfa810260856ebdf7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:04.258333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8524e0c-d2e3-4202-a429-9746817e76e6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:04.260408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 63/132] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:03 2022] GET /identity/v3/projects/4adbd6e7240147dfa810260856ebdf7a => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:04.266949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524e0c-d2e3-4202-a429-9746817e76e6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:04.352637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0adb76-765d-456b-8667-4339ed03cc43 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:04.393141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d1739-bf06-4544-9276-c6300d83575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:04.394832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d1739-bf06-4544-9276-c6300d83575e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:04.395984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d1739-bf06-4544-9276-c6300d83575e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:04.397138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d1739-bf06-4544-9276-c6300d83575e None admin] PATH_INFO: `/v3/users/4d8ff1adf571485e9d5a77b8f2a20ed2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:04.421581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d1739-bf06-4544-9276-c6300d83575e None admin] RBAC: Authorizing `identity:get_user(user_id=4d8ff1adf571485e9d5a77b8f2a20ed2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:04.424520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d1739-bf06-4544-9276-c6300d83575e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:04.427314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524e0c-d2e3-4202-a429-9746817e76e6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:04.430483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 70/133] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:04 2022] GET /identity/v3/users/4d8ff1adf571485e9d5a77b8f2a20ed2 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:04.437846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d1739-bf06-4544-9276-c6300d83575e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:04.495958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8319d-6bc4-4f7a-a70b-b96427d705e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:04.497083 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8319d-6bc4-4f7a-a70b-b96427d705e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:04.500253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8319d-6bc4-4f7a-a70b-b96427d705e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:04.500680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8319d-6bc4-4f7a-a70b-b96427d705e0 None admin] PATH_INFO: `/v3/projects/4adbd6e7240147dfa810260856ebdf7a/users/d63543b997cd4d44b3f069a642b26186/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:04.510968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8319d-6bc4-4f7a-a70b-b96427d705e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4adbd6e7240147dfa810260856ebdf7a, user_id=d63543b997cd4d44b3f069a642b26186, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:04.512626 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8319d-6bc4-4f7a-a70b-b96427d705e0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:04.534480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 64/134] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:28:04 2022] PUT /identity/v3/projects/4adbd6e7240147dfa810260856ebdf7a/users/d63543b997cd4d44b3f069a642b26186/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:04.588425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d1739-bf06-4544-9276-c6300d83575e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:04.628051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98fe7-e4c1-413c-b664-4bc7a26e1462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:04.628993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98fe7-e4c1-413c-b664-4bc7a26e1462 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:04.629423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98fe7-e4c1-413c-b664-4bc7a26e1462 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:04.629850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98fe7-e4c1-413c-b664-4bc7a26e1462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:04.704173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af98fe7-e4c1-413c-b664-4bc7a26e1462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:04.706526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af98fe7-e4c1-413c-b664-4bc7a26e1462 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:04.812859 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 71/135] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:04.818529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8319d-6bc4-4f7a-a70b-b96427d705e0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:04.928754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8319d-6bc4-4f7a-a70b-b96427d705e0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:04.966719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c336-f53d-4805-90cb-49c0b78d88ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:04.967821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c336-f53d-4805-90cb-49c0b78d88ed None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:04.968246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c336-f53d-4805-90cb-49c0b78d88ed None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:04.968658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c336-f53d-4805-90cb-49c0b78d88ed None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:04.969994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21c336-f53d-4805-90cb-49c0b78d88ed None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:04.971963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21c336-f53d-4805-90cb-49c0b78d88ed None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:04.973823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 65/136] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:04 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:04.980666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98fe7-e4c1-413c-b664-4bc7a26e1462 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:05.039741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9108c-5933-4d49-b40c-3c1540e65dd4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:05.040255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9108c-5933-4d49-b40c-3c1540e65dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:05.040746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9108c-5933-4d49-b40c-3c1540e65dd4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:05.042884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 66/137] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:28:05.048760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cb6d7-cec6-40cf-9a32-2914b858162b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:05.049314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cb6d7-cec6-40cf-9a32-2914b858162b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:05.049955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cb6d7-cec6-40cf-9a32-2914b858162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:05.072450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5d2cb6d7-cec6-40cf-9a32-2914b858162b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:05.074490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5d2cb6d7-cec6-40cf-9a32-2914b858162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:05.148909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98fe7-e4c1-413c-b664-4bc7a26e1462 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:05.215784 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ae29c-c320-43c8-b4d6-1641aed05cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:05.216004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 67/138] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:05.216531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ae29c-c320-43c8-b4d6-1641aed05cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:05.216715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ae29c-c320-43c8-b4d6-1641aed05cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:05.217044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ae29c-c320-43c8-b4d6-1641aed05cf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:05.217829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ae29c-c320-43c8-b4d6-1641aed05cf6 None admin] RBAC: Adding query filter params (role.id=b7d83811a60b4a6da03617d631508e1b, scope.project.id=40b91b4949b0461a99311b62cd96aa7a, user.id=4d8ff1adf571485e9d5a77b8f2a20ed2) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:05.218167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ae29c-c320-43c8-b4d6-1641aed05cf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:05.219608 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ae29c-c320-43c8-b4d6-1641aed05cf6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:05.240016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 72/139] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:04 2022] GET /identity/v3/role_assignments?user.id=4d8ff1adf571485e9d5a77b8f2a20ed2&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=b7d83811a60b4a6da03617d631508e1b => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:05.252928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cb6d7-cec6-40cf-9a32-2914b858162b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:05.401978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cb6d7-cec6-40cf-9a32-2914b858162b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:05.445797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224fe34-a57f-4494-9873-e279459d1ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:05.446655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224fe34-a57f-4494-9873-e279459d1ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:05.446944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224fe34-a57f-4494-9873-e279459d1ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:05.447228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224fe34-a57f-4494-9873-e279459d1ee5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:05.467156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224fe34-a57f-4494-9873-e279459d1ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d224fe34-a57f-4494-9873-e279459d1ee5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:05.475738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:05.476582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:05.477355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 68/140] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:05.487181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ae29c-c320-43c8-b4d6-1641aed05cf6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:05.650829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ae29c-c320-43c8-b4d6-1641aed05cf6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:05.690946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f3bb-daa0-4ed8-9bba-c5ce82c53de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:05.691995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f3bb-daa0-4ed8-9bba-c5ce82c53de9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:05.692493 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f3bb-daa0-4ed8-9bba-c5ce82c53de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:05.692961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f3bb-daa0-4ed8-9bba-c5ce82c53de9 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:05.694107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1f3bb-daa0-4ed8-9bba-c5ce82c53de9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:05.694611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1f3bb-daa0-4ed8-9bba-c5ce82c53de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:05.696221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1f3bb-daa0-4ed8-9bba-c5ce82c53de9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:05.705414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 73/141] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:05.711068 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224fe34-a57f-4494-9873-e279459d1ee5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:05.863600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224fe34-a57f-4494-9873-e279459d1ee5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:05.906608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dd204-6b46-41ce-994d-b7b35ae414fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:05.907485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dd204-6b46-41ce-994d-b7b35ae414fa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:05.907768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dd204-6b46-41ce-994d-b7b35ae414fa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:05.908070 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dd204-6b46-41ce-994d-b7b35ae414fa None admin] PATH_INFO: `/v3/users/d63543b997cd4d44b3f069a642b26186` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:05.914760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dd204-6b46-41ce-994d-b7b35ae414fa None admin] RBAC: Authorizing `identity:get_user(user_id=d63543b997cd4d44b3f069a642b26186)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:05.916263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dd204-6b46-41ce-994d-b7b35ae414fa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:05.917949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 69/142] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:05 2022] GET /identity/v3/users/d63543b997cd4d44b3f069a642b26186 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:05.923860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f3bb-daa0-4ed8-9bba-c5ce82c53de9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:06.060002 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f3bb-daa0-4ed8-9bba-c5ce82c53de9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:06.102705 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c016-4e85-4b29-9d5e-27357b41e1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:06.103364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c016-4e85-4b29-9d5e-27357b41e1de None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:06.103655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c016-4e85-4b29-9d5e-27357b41e1de None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:06.103938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c016-4e85-4b29-9d5e-27357b41e1de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:06.177008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14939dd-3733-4583-a79a-005a9696f090 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:06.177510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14939dd-3733-4583-a79a-005a9696f090 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:06.177612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14939dd-3733-4583-a79a-005a9696f090 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:06.179131 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 70/143] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:28:06.191944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305a665-e90f-492a-8928-a3a99638e28d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:06.192526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305a665-e90f-492a-8928-a3a99638e28d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:06.193000 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305a665-e90f-492a-8928-a3a99638e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:06.213035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938c016-4e85-4b29-9d5e-27357b41e1de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:06.214459 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938c016-4e85-4b29-9d5e-27357b41e1de None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:06.217381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1305a665-e90f-492a-8928-a3a99638e28d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:06.223682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1305a665-e90f-492a-8928-a3a99638e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:06.372279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 71/144] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:06.407415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305a665-e90f-492a-8928-a3a99638e28d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:06.444332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 74/145] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:06.446557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c016-4e85-4b29-9d5e-27357b41e1de None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:06.568894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c016-4e85-4b29-9d5e-27357b41e1de None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:06.604573 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305a665-e90f-492a-8928-a3a99638e28d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:06.609279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8ff4-aa24-4d50-9caa-264b768ae233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:06.610360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8ff4-aa24-4d50-9caa-264b768ae233 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:06.610744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8ff4-aa24-4d50-9caa-264b768ae233 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:06.611800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8ff4-aa24-4d50-9caa-264b768ae233 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:06.613120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c8ff4-aa24-4d50-9caa-264b768ae233 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:06.615171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c8ff4-aa24-4d50-9caa-264b768ae233 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:06.617671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 75/146] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:06 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:06.619568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefc4c-86ae-43b2-8eef-4bb4a89d0e61 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:06.620199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefc4c-86ae-43b2-8eef-4bb4a89d0e61 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:06.621060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefc4c-86ae-43b2-8eef-4bb4a89d0e61 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:06.623324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 76/147] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:06.624393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deefc4c-86ae-43b2-8eef-4bb4a89d0e61 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:06.670826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c7310-ef01-4b3c-ab49-94e44622b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:06.671563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7310-ef01-4b3c-ab49-94e44622b182 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:06.671851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7310-ef01-4b3c-ab49-94e44622b182 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:06.672129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7310-ef01-4b3c-ab49-94e44622b182 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:06.700381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c7310-ef01-4b3c-ab49-94e44622b182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-119c7310-ef01-4b3c-ab49-94e44622b182 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:06.708201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:06.709104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:06.709865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:06.712329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 72/148] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:06.713769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ceaa3-2140-46d8-9b76-e4e01c8bca8e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:06.714287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ceaa3-2140-46d8-9b76-e4e01c8bca8e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:06.714782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ceaa3-2140-46d8-9b76-e4e01c8bca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:06.732022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b27ceaa3-2140-46d8-9b76-e4e01c8bca8e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:06.733512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b27ceaa3-2140-46d8-9b76-e4e01c8bca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:06.740764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deefc4c-86ae-43b2-8eef-4bb4a89d0e61 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:06.777087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235de7cb-4d93-401c-aa0b-90f1d2058cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:06.778040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235de7cb-4d93-401c-aa0b-90f1d2058cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:06.778743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235de7cb-4d93-401c-aa0b-90f1d2058cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:06.779214 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235de7cb-4d93-401c-aa0b-90f1d2058cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:06.780216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235de7cb-4d93-401c-aa0b-90f1d2058cf0 None admin] RBAC: Adding query filter params (role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=40b91b4949b0461a99311b62cd96aa7a, user.id=d63543b997cd4d44b3f069a642b26186) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:06.780710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235de7cb-4d93-401c-aa0b-90f1d2058cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:06.783322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235de7cb-4d93-401c-aa0b-90f1d2058cf0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:06.789653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 77/149] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:06 2022] GET /identity/v3/role_assignments?user.id=d63543b997cd4d44b3f069a642b26186&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:06.790959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235de7cb-4d93-401c-aa0b-90f1d2058cf0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:06.901553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 73/150] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:06.915652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235de7cb-4d93-401c-aa0b-90f1d2058cf0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:06.936672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ceaa3-2140-46d8-9b76-e4e01c8bca8e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:06.977394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e7d00-a1c7-4a65-9c4e-f2b7b199d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:06.979433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e7d00-a1c7-4a65-9c4e-f2b7b199d694 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:06.980059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e7d00-a1c7-4a65-9c4e-f2b7b199d694 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:06.981638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e7d00-a1c7-4a65-9c4e-f2b7b199d694 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:06.982599 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e7d00-a1c7-4a65-9c4e-f2b7b199d694 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:06.983737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e7d00-a1c7-4a65-9c4e-f2b7b199d694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:06.985981 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e7d00-a1c7-4a65-9c4e-f2b7b199d694 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:07.002059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 78/151] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:07.007916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e7d00-a1c7-4a65-9c4e-f2b7b199d694 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:07.116435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ceaa3-2140-46d8-9b76-e4e01c8bca8e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:07.161216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1a35-da63-4388-82a7-344b6a935ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:07.162816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1a35-da63-4388-82a7-344b6a935ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:07.163322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1a35-da63-4388-82a7-344b6a935ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:07.163788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1a35-da63-4388-82a7-344b6a935ba8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:07.176764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b1a35-da63-4388-82a7-344b6a935ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c59b1a35-da63-4388-82a7-344b6a935ba8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:07.186072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:07.187431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:07.188192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:07.191503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 74/152] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:07.198922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1a35-da63-4388-82a7-344b6a935ba8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:07.214069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e7d00-a1c7-4a65-9c4e-f2b7b199d694 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:07.259664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13ce41-ae8c-435e-a0c1-42b3e3b0bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:07.261145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13ce41-ae8c-435e-a0c1-42b3e3b0bf7a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:07.261530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13ce41-ae8c-435e-a0c1-42b3e3b0bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:07.262201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13ce41-ae8c-435e-a0c1-42b3e3b0bf7a None admin] PATH_INFO: `/v3/users/2ee5e213008a431f98430b648aa9d659` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:07.263582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13ce41-ae8c-435e-a0c1-42b3e3b0bf7a None admin] RBAC: Authorizing `identity:get_user(user_id=2ee5e213008a431f98430b648aa9d659)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:07.265366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13ce41-ae8c-435e-a0c1-42b3e3b0bf7a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:07.268664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 79/153] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:07 2022] GET /identity/v3/users/2ee5e213008a431f98430b648aa9d659 => generated 247 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:07.274993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13ce41-ae8c-435e-a0c1-42b3e3b0bf7a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:07.358665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1a35-da63-4388-82a7-344b6a935ba8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:07.393267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fe9b-96ad-4761-a509-df7d6fb7781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:07.395753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fe9b-96ad-4761-a509-df7d6fb7781b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:07.396162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fe9b-96ad-4761-a509-df7d6fb7781b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:07.396549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fe9b-96ad-4761-a509-df7d6fb7781b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:07.397443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fe9b-96ad-4761-a509-df7d6fb7781b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:07.397890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fe9b-96ad-4761-a509-df7d6fb7781b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:07.399454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fe9b-96ad-4761-a509-df7d6fb7781b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:07.407967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 75/154] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:07.413370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fe9b-96ad-4761-a509-df7d6fb7781b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:07.429076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13ce41-ae8c-435e-a0c1-42b3e3b0bf7a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:07.478963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9ccde-e614-4462-890a-1a806cf84bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:07.479841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9ccde-e614-4462-890a-1a806cf84bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:07.480267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9ccde-e614-4462-890a-1a806cf84bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:07.480701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9ccde-e614-4462-890a-1a806cf84bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:07.519913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fe9b-96ad-4761-a509-df7d6fb7781b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:07.554312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42bcf0-f8cd-407a-b3f8-50370697340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:07.555397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42bcf0-f8cd-407a-b3f8-50370697340a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:07.555723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42bcf0-f8cd-407a-b3f8-50370697340a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:07.556103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42bcf0-f8cd-407a-b3f8-50370697340a None admin] PATH_INFO: `/v3/users/d63543b997cd4d44b3f069a642b26186` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:07.557421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42bcf0-f8cd-407a-b3f8-50370697340a None admin] RBAC: Authorizing `identity:get_user(user_id=d63543b997cd4d44b3f069a642b26186)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:07.559054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42bcf0-f8cd-407a-b3f8-50370697340a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:07.565354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 76/155] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:07 2022] GET /identity/v3/users/d63543b997cd4d44b3f069a642b26186 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:07.567223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42bcf0-f8cd-407a-b3f8-50370697340a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:07.575436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9ccde-e614-4462-890a-1a806cf84bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:07.582021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9ccde-e614-4462-890a-1a806cf84bf5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:07.668438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42bcf0-f8cd-407a-b3f8-50370697340a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:07.703413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 80/156] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 15:28:07.708934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9ccde-e614-4462-890a-1a806cf84bf5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:07.740386 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c9071-0ed2-4bc3-971d-3ed02eea6c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:07.740970 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c9071-0ed2-4bc3-971d-3ed02eea6c30 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:07.741251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c9071-0ed2-4bc3-971d-3ed02eea6c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:07.741525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c9071-0ed2-4bc3-971d-3ed02eea6c30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:07.809008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c9071-0ed2-4bc3-971d-3ed02eea6c30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:07.810511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c9071-0ed2-4bc3-971d-3ed02eea6c30 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:07.824900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9ccde-e614-4462-890a-1a806cf84bf5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:07.870581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db689b1-c5de-413d-89da-502123620793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:07.872014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db689b1-c5de-413d-89da-502123620793 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:07.872299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db689b1-c5de-413d-89da-502123620793 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:07.872575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db689b1-c5de-413d-89da-502123620793 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:07.874231 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db689b1-c5de-413d-89da-502123620793 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:07.875968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db689b1-c5de-413d-89da-502123620793 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:07.879020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 81/157] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:07 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:07.880255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1ccbd-fd28-481c-a7a3-c2463ef31ae6 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:07.880535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1ccbd-fd28-481c-a7a3-c2463ef31ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:07.880805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1ccbd-fd28-481c-a7a3-c2463ef31ae6 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:07.882033 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 82/158] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:07.885722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1ccbd-fd28-481c-a7a3-c2463ef31ae6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:07.922252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 77/159] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:07.923934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd88a8-6f90-4cde-aaea-dc3e0e0025db None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:07.924228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd88a8-6f90-4cde-aaea-dc3e0e0025db None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:07.924510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd88a8-6f90-4cde-aaea-dc3e0e0025db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:07.947109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f1bd88a8-6f90-4cde-aaea-dc3e0e0025db None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:07.948043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f1bd88a8-6f90-4cde-aaea-dc3e0e0025db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:08.012992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1ccbd-fd28-481c-a7a3-c2463ef31ae6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.030479 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 78/160] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:08.032263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd88a8-6f90-4cde-aaea-dc3e0e0025db None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.053640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c619-c395-4a3a-83ea-10408e370271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.054719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c619-c395-4a3a-83ea-10408e370271 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.055021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c619-c395-4a3a-83ea-10408e370271 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.055314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c619-c395-4a3a-83ea-10408e370271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.056160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c619-c395-4a3a-83ea-10408e370271 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=40b91b4949b0461a99311b62cd96aa7a, user.id=2ee5e213008a431f98430b648aa9d659) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:08.056466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c619-c395-4a3a-83ea-10408e370271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:08.057908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c619-c395-4a3a-83ea-10408e370271 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:08.063842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 83/161] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:07 2022] GET /identity/v3/role_assignments?user.id=2ee5e213008a431f98430b648aa9d659&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=cb77715547a14bae950f68513af00d30 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:08.065722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639974-b3c8-485d-8c62-72f9ade8160d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.066024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639974-b3c8-485d-8c62-72f9ade8160d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.066302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639974-b3c8-485d-8c62-72f9ade8160d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.067694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 84/162] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:08.072478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639974-b3c8-485d-8c62-72f9ade8160d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.150790 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd88a8-6f90-4cde-aaea-dc3e0e0025db None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.186986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991fc8-c20e-45e9-bdb3-c12b9e44eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.187949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991fc8-c20e-45e9-bdb3-c12b9e44eefe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.188660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991fc8-c20e-45e9-bdb3-c12b9e44eefe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.188660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991fc8-c20e-45e9-bdb3-c12b9e44eefe None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.190294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991fc8-c20e-45e9-bdb3-c12b9e44eefe None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:08.191824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991fc8-c20e-45e9-bdb3-c12b9e44eefe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:08.193886 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 79/163] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:08.195182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea81a-4b8c-46ba-8bf0-b5002f24a7d2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.195461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea81a-4b8c-46ba-8bf0-b5002f24a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.195734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea81a-4b8c-46ba-8bf0-b5002f24a7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.205483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639974-b3c8-485d-8c62-72f9ade8160d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.213855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-354ea81a-4b8c-46ba-8bf0-b5002f24a7d2 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:08.215318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-354ea81a-4b8c-46ba-8bf0-b5002f24a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:08.247389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cdd20-a76d-482d-b4b6-057faf327652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.248546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cdd20-a76d-482d-b4b6-057faf327652 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.249007 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cdd20-a76d-482d-b4b6-057faf327652 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.249455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cdd20-a76d-482d-b4b6-057faf327652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.251166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cdd20-a76d-482d-b4b6-057faf327652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:08.252955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cdd20-a76d-482d-b4b6-057faf327652 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:08.254946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 85/164] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:08.256047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cdd20-a76d-482d-b4b6-057faf327652 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.291285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 80/165] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:08.292213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ea81a-4b8c-46ba-8bf0-b5002f24a7d2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.373968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cdd20-a76d-482d-b4b6-057faf327652 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.399126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ea81a-4b8c-46ba-8bf0-b5002f24a7d2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.405239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586625f-6cdf-403a-b231-272c50cb6811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.405879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586625f-6cdf-403a-b231-272c50cb6811 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.406186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586625f-6cdf-403a-b231-272c50cb6811 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.406458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586625f-6cdf-403a-b231-272c50cb6811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.407273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586625f-6cdf-403a-b231-272c50cb6811 None admin] RBAC: Adding query filter params (role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=40b91b4949b0461a99311b62cd96aa7a, user.id=d63543b997cd4d44b3f069a642b26186) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:08.407575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586625f-6cdf-403a-b231-272c50cb6811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:08.409595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586625f-6cdf-403a-b231-272c50cb6811 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:08.415135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 86/166] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/role_assignments?user.id=d63543b997cd4d44b3f069a642b26186&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:08.416301 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e997952-43f5-468e-96a3-34c63a554f89 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.416585 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e997952-43f5-468e-96a3-34c63a554f89 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.416853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e997952-43f5-468e-96a3-34c63a554f89 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.418074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 87/167] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:08.418765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e997952-43f5-468e-96a3-34c63a554f89 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.437939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c773d-4cc1-4e48-9171-5e350d5c08a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.438650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c773d-4cc1-4e48-9171-5e350d5c08a3 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.438926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c773d-4cc1-4e48-9171-5e350d5c08a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.439231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c773d-4cc1-4e48-9171-5e350d5c08a3 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.439949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c773d-4cc1-4e48-9171-5e350d5c08a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:08.441428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c773d-4cc1-4e48-9171-5e350d5c08a3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:08.471800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 81/168] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:08 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:08.473696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15d9ef-e0dc-4e2e-876d-a2dc77d88a5a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.473940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15d9ef-e0dc-4e2e-876d-a2dc77d88a5a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.474321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15d9ef-e0dc-4e2e-876d-a2dc77d88a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.492328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4d15d9ef-e0dc-4e2e-876d-a2dc77d88a5a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:08.493564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4d15d9ef-e0dc-4e2e-876d-a2dc77d88a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:08.532665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e997952-43f5-468e-96a3-34c63a554f89 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.571311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32115db-c00b-46ab-906a-7e50fce2908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.572039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32115db-c00b-46ab-906a-7e50fce2908b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.572323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32115db-c00b-46ab-906a-7e50fce2908b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.572598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32115db-c00b-46ab-906a-7e50fce2908b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.585334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32115db-c00b-46ab-906a-7e50fce2908b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:08.593951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 82/169] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c32115db-c00b-46ab-906a-7e50fce2908b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:08.595583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:08.597311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:08.598118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:08.601147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 88/170] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:08.607628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15d9ef-e0dc-4e2e-876d-a2dc77d88a5a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.619615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32115db-c00b-46ab-906a-7e50fce2908b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.733159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32115db-c00b-46ab-906a-7e50fce2908b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.734080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15d9ef-e0dc-4e2e-876d-a2dc77d88a5a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.768326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc3292-e81f-46c9-8737-3dad935182b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.769471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc3292-e81f-46c9-8737-3dad935182b7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.769957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc3292-e81f-46c9-8737-3dad935182b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.770372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc3292-e81f-46c9-8737-3dad935182b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.771302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faddfa7-5581-47c2-8418-e36881b3edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.771972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faddfa7-5581-47c2-8418-e36881b3edb3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.772256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faddfa7-5581-47c2-8418-e36881b3edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.772536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faddfa7-5581-47c2-8418-e36881b3edb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.773299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faddfa7-5581-47c2-8418-e36881b3edb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:08.773606 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faddfa7-5581-47c2-8418-e36881b3edb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:08.775039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faddfa7-5581-47c2-8418-e36881b3edb3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:08.780619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc3292-e81f-46c9-8737-3dad935182b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:08.783611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 83/171] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f7bc3292-e81f-46c9-8737-3dad935182b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:08.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:08.789506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:08.790764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 89/172] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:08.791408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faddfa7-5581-47c2-8418-e36881b3edb3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.796539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc3292-e81f-46c9-8737-3dad935182b7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.900735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc3292-e81f-46c9-8737-3dad935182b7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.904283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faddfa7-5581-47c2-8418-e36881b3edb3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:08.936147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb5810-eb27-4a0a-a9a7-1e155ecd1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.937201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb5810-eb27-4a0a-a9a7-1e155ecd1647 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.937630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb5810-eb27-4a0a-a9a7-1e155ecd1647 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.938170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb5810-eb27-4a0a-a9a7-1e155ecd1647 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.938706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a12969-5df4-4f1c-9298-3e0c15d8abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:08.939799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb5810-eb27-4a0a-a9a7-1e155ecd1647 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:08.940252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb5810-eb27-4a0a-a9a7-1e155ecd1647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:08.940362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a12969-5df4-4f1c-9298-3e0c15d8abf9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:08.940712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a12969-5df4-4f1c-9298-3e0c15d8abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:08.941077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a12969-5df4-4f1c-9298-3e0c15d8abf9 None admin] PATH_INFO: `/v3/users/d63543b997cd4d44b3f069a642b26186` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:08.942345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb5810-eb27-4a0a-a9a7-1e155ecd1647 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:08.942459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a12969-5df4-4f1c-9298-3e0c15d8abf9 None admin] RBAC: Authorizing `identity:get_user(user_id=d63543b997cd4d44b3f069a642b26186)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:08.944035 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a12969-5df4-4f1c-9298-3e0c15d8abf9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:08.950078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 84/173] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/users/d63543b997cd4d44b3f069a642b26186 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:08.951750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a12969-5df4-4f1c-9298-3e0c15d8abf9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:08.952373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 90/174] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:08.958982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb5810-eb27-4a0a-a9a7-1e155ecd1647 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:09.059884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a12969-5df4-4f1c-9298-3e0c15d8abf9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:09.062643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb5810-eb27-4a0a-a9a7-1e155ecd1647 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:09.093708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98b67f-cafe-4ef3-a36f-c95b0ccf054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:09.094392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98b67f-cafe-4ef3-a36f-c95b0ccf054f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:09.094736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98b67f-cafe-4ef3-a36f-c95b0ccf054f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:09.094947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98b67f-cafe-4ef3-a36f-c95b0ccf054f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:09.096622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1359-78da-482e-827d-53fc599db00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:09.097491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1359-78da-482e-827d-53fc599db00a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:09.097766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1359-78da-482e-827d-53fc599db00a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:09.098056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1359-78da-482e-827d-53fc599db00a None admin] PATH_INFO: `/v3/users/4d8ff1adf571485e9d5a77b8f2a20ed2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:09.099260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca1359-78da-482e-827d-53fc599db00a None admin] RBAC: Authorizing `identity:get_user(user_id=4d8ff1adf571485e9d5a77b8f2a20ed2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:09.100702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca1359-78da-482e-827d-53fc599db00a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:09.102661 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 91/175] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/users/4d8ff1adf571485e9d5a77b8f2a20ed2 => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:09.107787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1359-78da-482e-827d-53fc599db00a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:09.168307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98b67f-cafe-4ef3-a36f-c95b0ccf054f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:09.169768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98b67f-cafe-4ef3-a36f-c95b0ccf054f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:09.230137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1359-78da-482e-827d-53fc599db00a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:09.273110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c840aa-5499-4e87-885c-fd62a7868045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:09.274091 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c840aa-5499-4e87-885c-fd62a7868045 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:09.274491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c840aa-5499-4e87-885c-fd62a7868045 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:09.274860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c840aa-5499-4e87-885c-fd62a7868045 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:09.276118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c840aa-5499-4e87-885c-fd62a7868045 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:09.277708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c840aa-5499-4e87-885c-fd62a7868045 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:09.278937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 85/176] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 15:28:09.282046 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 92/177] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:09 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:09.284710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98b67f-cafe-4ef3-a36f-c95b0ccf054f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:09.287548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c840aa-5499-4e87-885c-fd62a7868045 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:09.417151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98b67f-cafe-4ef3-a36f-c95b0ccf054f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:09.456199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadffe2-4bdb-454b-b213-798701930f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:09.457419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadffe2-4bdb-454b-b213-798701930f52 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:09.457893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadffe2-4bdb-454b-b213-798701930f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:09.458471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadffe2-4bdb-454b-b213-798701930f52 None admin] PATH_INFO: `/v3/projects/4adbd6e7240147dfa810260856ebdf7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:09.462383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadffe2-4bdb-454b-b213-798701930f52 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbd6e7240147dfa810260856ebdf7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:09.464708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadffe2-4bdb-454b-b213-798701930f52 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:09.469105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 86/178] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:09 2022] GET /identity/v3/projects/4adbd6e7240147dfa810260856ebdf7a => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:09.475436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadffe2-4bdb-454b-b213-798701930f52 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:09.479790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c840aa-5499-4e87-885c-fd62a7868045 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:09.570726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ea96c-5948-46a4-9f79-05d506d3c8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:09.571644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ea96c-5948-46a4-9f79-05d506d3c8de None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:09.571935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ea96c-5948-46a4-9f79-05d506d3c8de None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:09.572216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ea96c-5948-46a4-9f79-05d506d3c8de None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a/users/4d8ff1adf571485e9d5a77b8f2a20ed2/roles/b7d83811a60b4a6da03617d631508e1b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:09.574300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ea96c-5948-46a4-9f79-05d506d3c8de None admin] RBAC: Authorizing `identity:create_grant(project_id=40b91b4949b0461a99311b62cd96aa7a, user_id=4d8ff1adf571485e9d5a77b8f2a20ed2, role_id=b7d83811a60b4a6da03617d631508e1b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:09.575757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ea96c-5948-46a4-9f79-05d506d3c8de None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:09.582300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadffe2-4bdb-454b-b213-798701930f52 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:09.616224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 93/179] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:28:09 2022] PUT /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a/users/4d8ff1adf571485e9d5a77b8f2a20ed2/roles/b7d83811a60b4a6da03617d631508e1b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:28:09.620101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da74bc6-a4a1-4e4c-bfc0-da6e8ed377b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:09.621126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74bc6-a4a1-4e4c-bfc0-da6e8ed377b5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:09.621627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74bc6-a4a1-4e4c-bfc0-da6e8ed377b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:09.622181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74bc6-a4a1-4e4c-bfc0-da6e8ed377b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:09.623286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da74bc6-a4a1-4e4c-bfc0-da6e8ed377b5 None admin] RBAC: Adding query filter params (role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=4adbd6e7240147dfa810260856ebdf7a, user.id=d63543b997cd4d44b3f069a642b26186) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:09.623823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da74bc6-a4a1-4e4c-bfc0-da6e8ed377b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:09.625642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da74bc6-a4a1-4e4c-bfc0-da6e8ed377b5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:09.633430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 87/180] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:09 2022] GET /identity/v3/role_assignments?user.id=d63543b997cd4d44b3f069a642b26186&scope.project.id=4adbd6e7240147dfa810260856ebdf7a&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:11.076633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1e82a-313a-44b8-b535-ce5b536b3fdc None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.077698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1e82a-313a-44b8-b535-ce5b536b3fdc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.078210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1e82a-313a-44b8-b535-ce5b536b3fdc None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.080704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 94/181] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:11.086339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5c4b-3dd0-4c82-b27b-8fadf9bc6d35 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.087172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5c4b-3dd0-4c82-b27b-8fadf9bc6d35 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.087663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5c4b-3dd0-4c82-b27b-8fadf9bc6d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.104913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1b3d5c4b-3dd0-4c82-b27b-8fadf9bc6d35 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:11.106462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1b3d5c4b-3dd0-4c82-b27b-8fadf9bc6d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:11.150069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5b530-e92f-4b8a-9255-9298aafc2c4e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.150359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5b530-e92f-4b8a-9255-9298aafc2c4e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.150638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5b530-e92f-4b8a-9255-9298aafc2c4e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.152203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 95/182] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:11.157789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc219-d1ce-42c8-97c7-a760c96f975a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.158159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc219-d1ce-42c8-97c7-a760c96f975a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.158549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc219-d1ce-42c8-97c7-a760c96f975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.177735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6f7bc219-d1ce-42c8-97c7-a760c96f975a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:11.179247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6f7bc219-d1ce-42c8-97c7-a760c96f975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:11.181829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 88/183] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:11.205880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5c4b-3dd0-4c82-b27b-8fadf9bc6d35 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:11.260754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 96/184] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:11.284022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc219-d1ce-42c8-97c7-a760c96f975a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:11.327733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5c4b-3dd0-4c82-b27b-8fadf9bc6d35 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:11.368567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12d639-b72a-4ee0-89dc-3bb25c117cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:11.370516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12d639-b72a-4ee0-89dc-3bb25c117cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.371022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12d639-b72a-4ee0-89dc-3bb25c117cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.371963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12d639-b72a-4ee0-89dc-3bb25c117cb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.387609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12d639-b72a-4ee0-89dc-3bb25c117cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:11.397680 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc219-d1ce-42c8-97c7-a760c96f975a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8d12d639-b72a-4ee0-89dc-3bb25c117cb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:11.398904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:11.399776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:11.400589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:11.404095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 89/185] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:28:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:11.409523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12d639-b72a-4ee0-89dc-3bb25c117cb4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:11.447334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839848a-0984-44c5-a855-4ead334b82ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:11.448136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839848a-0984-44c5-a855-4ead334b82ca None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.448415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839848a-0984-44c5-a855-4ead334b82ca None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.448683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839848a-0984-44c5-a855-4ead334b82ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.460905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839848a-0984-44c5-a855-4ead334b82ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e839848a-0984-44c5-a855-4ead334b82ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:11.469110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:11.470390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:11.471811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 97/186] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:11.476351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839848a-0984-44c5-a855-4ead334b82ca None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:11.538920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12d639-b72a-4ee0-89dc-3bb25c117cb4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:11.573158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84e04f-08c1-4031-9dcb-38b671f163dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:11.573893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84e04f-08c1-4031-9dcb-38b671f163dd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.574213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84e04f-08c1-4031-9dcb-38b671f163dd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.574488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84e04f-08c1-4031-9dcb-38b671f163dd None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.575237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84e04f-08c1-4031-9dcb-38b671f163dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:11.575544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84e04f-08c1-4031-9dcb-38b671f163dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:11.576932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84e04f-08c1-4031-9dcb-38b671f163dd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:11.585476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 90/187] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:11.588179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329629-8601-42ad-af49-631207d25b22 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.588674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329629-8601-42ad-af49-631207d25b22 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.589256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329629-8601-42ad-af49-631207d25b22 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.591348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 91/188] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:11.596012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839848a-0984-44c5-a855-4ead334b82ca None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:11.596899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7329629-8601-42ad-af49-631207d25b22 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:11.629932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8dee4-4c8e-4c7e-870b-2caf24ffb8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:11.630623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8dee4-4c8e-4c7e-870b-2caf24ffb8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.630919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8dee4-4c8e-4c7e-870b-2caf24ffb8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.631177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8dee4-4c8e-4c7e-870b-2caf24ffb8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.631919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8dee4-4c8e-4c7e-870b-2caf24ffb8d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:11.632218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8dee4-4c8e-4c7e-870b-2caf24ffb8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:11.633584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8dee4-4c8e-4c7e-870b-2caf24ffb8d1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:11.641398 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 98/189] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:11.642921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07269d-fc91-4e11-97aa-2d60ecff92c9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.643201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07269d-fc91-4e11-97aa-2d60ecff92c9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.643477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07269d-fc91-4e11-97aa-2d60ecff92c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.659201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fd07269d-fc91-4e11-97aa-2d60ecff92c9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:11.660364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fd07269d-fc91-4e11-97aa-2d60ecff92c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:11.699861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7329629-8601-42ad-af49-631207d25b22 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:11.724571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 99/190] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:11.732988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07269d-fc91-4e11-97aa-2d60ecff92c9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:11.743715 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd1669-a081-467c-8514-c05f410e3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:11.744759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd1669-a081-467c-8514-c05f410e3328 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.745184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd1669-a081-467c-8514-c05f410e3328 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.746041 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd1669-a081-467c-8514-c05f410e3328 None admin] PATH_INFO: `/v3/users/c89b7e9057214915a36fb638e82eedcf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.761718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd1669-a081-467c-8514-c05f410e3328 None admin] RBAC: Authorizing `identity:get_user(user_id=c89b7e9057214915a36fb638e82eedcf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:11.763478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd1669-a081-467c-8514-c05f410e3328 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:11.765344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 92/191] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:11 2022] GET /identity/v3/users/c89b7e9057214915a36fb638e82eedcf => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:11.765344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd1669-a081-467c-8514-c05f410e3328 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:11.827491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07269d-fc91-4e11-97aa-2d60ecff92c9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:11.862523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393513d-ba1a-49b1-981d-a42ff1610cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:11.863394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393513d-ba1a-49b1-981d-a42ff1610cdc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.863670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393513d-ba1a-49b1-981d-a42ff1610cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.863939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393513d-ba1a-49b1-981d-a42ff1610cdc None admin] PATH_INFO: `/v3/users/c89b7e9057214915a36fb638e82eedcf` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.865092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393513d-ba1a-49b1-981d-a42ff1610cdc None admin] RBAC: Authorizing `identity:get_user(user_id=c89b7e9057214915a36fb638e82eedcf)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:11.866613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393513d-ba1a-49b1-981d-a42ff1610cdc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:11.868402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 100/192] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:11 2022] GET /identity/v3/users/c89b7e9057214915a36fb638e82eedcf => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:11.868816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd1669-a081-467c-8514-c05f410e3328 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:11.870859 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393513d-ba1a-49b1-981d-a42ff1610cdc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:11.902909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5091a3-2226-482d-be47-2f0edb009b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:11.903690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5091a3-2226-482d-be47-2f0edb009b12 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:11.903963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5091a3-2226-482d-be47-2f0edb009b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:11.904861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5091a3-2226-482d-be47-2f0edb009b12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:11.905380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5091a3-2226-482d-be47-2f0edb009b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:11.906843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5091a3-2226-482d-be47-2f0edb009b12 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:11.909169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 93/193] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:11.909732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5091a3-2226-482d-be47-2f0edb009b12 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:11.971602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393513d-ba1a-49b1-981d-a42ff1610cdc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:12.004398 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d42bf-60c8-42d5-9c15-229de1a92c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:12.005038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d42bf-60c8-42d5-9c15-229de1a92c94 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.005314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d42bf-60c8-42d5-9c15-229de1a92c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.005583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d42bf-60c8-42d5-9c15-229de1a92c94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.006609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5091a3-2226-482d-be47-2f0edb009b12 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:12.038578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16260ef-3a2b-4390-bd11-009bdffe27fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:12.039212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16260ef-3a2b-4390-bd11-009bdffe27fc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.039494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16260ef-3a2b-4390-bd11-009bdffe27fc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.039771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16260ef-3a2b-4390-bd11-009bdffe27fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.069482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d42bf-60c8-42d5-9c15-229de1a92c94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:12.070981 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d42bf-60c8-42d5-9c15-229de1a92c94 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:12.106216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16260ef-3a2b-4390-bd11-009bdffe27fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:12.107665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16260ef-3a2b-4390-bd11-009bdffe27fc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:12.163461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 101/194] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:12.164282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d42bf-60c8-42d5-9c15-229de1a92c94 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:12.201104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 94/195] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:12.202654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd93050-5ad9-4450-b26a-4f45889a4f75 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.202939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd93050-5ad9-4450-b26a-4f45889a4f75 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.203211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd93050-5ad9-4450-b26a-4f45889a4f75 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.204967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 95/196] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:12.205766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd93050-5ad9-4450-b26a-4f45889a4f75 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:12.259174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d42bf-60c8-42d5-9c15-229de1a92c94 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:12.290884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48833a-f359-41ed-bd30-21bc2f4e1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:12.291545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48833a-f359-41ed-bd30-21bc2f4e1d44 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.291822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48833a-f359-41ed-bd30-21bc2f4e1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.292093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48833a-f359-41ed-bd30-21bc2f4e1d44 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.292778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48833a-f359-41ed-bd30-21bc2f4e1d44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:12.294243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48833a-f359-41ed-bd30-21bc2f4e1d44 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:12.304963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd93050-5ad9-4450-b26a-4f45889a4f75 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:12.312548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 102/197] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:12 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:12.314155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88789f-2635-454f-97b9-ee93c17b2c3a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.314643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88789f-2635-454f-97b9-ee93c17b2c3a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.314758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88789f-2635-454f-97b9-ee93c17b2c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.332245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ea88789f-2635-454f-97b9-ee93c17b2c3a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:12.333502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ea88789f-2635-454f-97b9-ee93c17b2c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:12.341505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35142b66-b2cd-430c-83da-8d1b6c175b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:12.342434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35142b66-b2cd-430c-83da-8d1b6c175b33 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.342718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35142b66-b2cd-430c-83da-8d1b6c175b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.342996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35142b66-b2cd-430c-83da-8d1b6c175b33 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.344292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35142b66-b2cd-430c-83da-8d1b6c175b33 None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:12.346640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35142b66-b2cd-430c-83da-8d1b6c175b33 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:12.348435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 96/198] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:12 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:12.349308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35142b66-b2cd-430c-83da-8d1b6c175b33 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:12.425333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 103/199] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:12.427075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88789f-2635-454f-97b9-ee93c17b2c3a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:12.469042 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35142b66-b2cd-430c-83da-8d1b6c175b33 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:12.506505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183c274-345f-4e5f-bbaa-0e33d623fdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:12.507369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183c274-345f-4e5f-bbaa-0e33d623fdcc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.507642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183c274-345f-4e5f-bbaa-0e33d623fdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.508568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183c274-345f-4e5f-bbaa-0e33d623fdcc None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.509738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183c274-345f-4e5f-bbaa-0e33d623fdcc None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:12.512282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183c274-345f-4e5f-bbaa-0e33d623fdcc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:12.512282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 97/200] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:12 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:12.513436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183c274-345f-4e5f-bbaa-0e33d623fdcc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:12.540066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88789f-2635-454f-97b9-ee93c17b2c3a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:12.586365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035c606-7eea-4492-bd6c-e13be5ad0cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:12.587178 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035c606-7eea-4492-bd6c-e13be5ad0cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.587773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035c606-7eea-4492-bd6c-e13be5ad0cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.588050 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035c606-7eea-4492-bd6c-e13be5ad0cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.588885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035c606-7eea-4492-bd6c-e13be5ad0cc0 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339, user.id=c89b7e9057214915a36fb638e82eedcf) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:12.591178 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035c606-7eea-4492-bd6c-e13be5ad0cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:12.591505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035c606-7eea-4492-bd6c-e13be5ad0cc0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:12.599535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 104/201] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:12 2022] GET /identity/v3/role_assignments?user.id=c89b7e9057214915a36fb638e82eedcf&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=cb77715547a14bae950f68513af00d30 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:12.600783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035c606-7eea-4492-bd6c-e13be5ad0cc0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:12.635166 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183c274-345f-4e5f-bbaa-0e33d623fdcc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:12.682471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbe0be-3092-475f-abc4-aaae2b1f420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:12.683211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbe0be-3092-475f-abc4-aaae2b1f420e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.683492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbe0be-3092-475f-abc4-aaae2b1f420e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.683765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbe0be-3092-475f-abc4-aaae2b1f420e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.698195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbe0be-3092-475f-abc4-aaae2b1f420e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-79cbe0be-3092-475f-abc4-aaae2b1f420e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:12.707119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:12.708052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:12.708851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:12.711358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 98/202] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:12.717580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbe0be-3092-475f-abc4-aaae2b1f420e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:12.740652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035c606-7eea-4492-bd6c-e13be5ad0cc0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:12.779507 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da64597-58d6-4f0a-aeaf-a64619547dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:12.780185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da64597-58d6-4f0a-aeaf-a64619547dae None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.780526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da64597-58d6-4f0a-aeaf-a64619547dae None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.780739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da64597-58d6-4f0a-aeaf-a64619547dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.781584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da64597-58d6-4f0a-aeaf-a64619547dae None admin] RBAC: Adding query filter params (role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339, user.id=c89b7e9057214915a36fb638e82eedcf) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:12.781893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da64597-58d6-4f0a-aeaf-a64619547dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:12.783548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da64597-58d6-4f0a-aeaf-a64619547dae None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:12.789708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 105/203] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:12 2022] GET /identity/v3/role_assignments?user.id=c89b7e9057214915a36fb638e82eedcf&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:12.861768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbe0be-3092-475f-abc4-aaae2b1f420e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:12.898597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13560d0-c0ec-4828-894c-6eac226c3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:12.899263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13560d0-c0ec-4828-894c-6eac226c3f0b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:12.899546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13560d0-c0ec-4828-894c-6eac226c3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:12.899817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13560d0-c0ec-4828-894c-6eac226c3f0b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:12.900583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13560d0-c0ec-4828-894c-6eac226c3f0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:12.900889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13560d0-c0ec-4828-894c-6eac226c3f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:12.902364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13560d0-c0ec-4828-894c-6eac226c3f0b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:12.911441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 99/204] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:12.917056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da64597-58d6-4f0a-aeaf-a64619547dae None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:13.037086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da64597-58d6-4f0a-aeaf-a64619547dae None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:13.084558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a8ee9-2ac2-42c2-aa29-396b26f18224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:13.085464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a8ee9-2ac2-42c2-aa29-396b26f18224 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:13.085743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a8ee9-2ac2-42c2-aa29-396b26f18224 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:13.086032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a8ee9-2ac2-42c2-aa29-396b26f18224 None admin] PATH_INFO: `/v3/users/4d8ff1adf571485e9d5a77b8f2a20ed2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:13.087306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a8ee9-2ac2-42c2-aa29-396b26f18224 None admin] RBAC: Authorizing `identity:get_user(user_id=4d8ff1adf571485e9d5a77b8f2a20ed2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:13.088780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a8ee9-2ac2-42c2-aa29-396b26f18224 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:13.090802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 106/205] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:12 2022] GET /identity/v3/users/4d8ff1adf571485e9d5a77b8f2a20ed2 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:13.096052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13560d0-c0ec-4828-894c-6eac226c3f0b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:13.219990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13560d0-c0ec-4828-894c-6eac226c3f0b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:13.269280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a1ab7-a803-4dee-b881-82832a4cbbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:13.269923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a1ab7-a803-4dee-b881-82832a4cbbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:13.270231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a1ab7-a803-4dee-b881-82832a4cbbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:13.270562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a1ab7-a803-4dee-b881-82832a4cbbd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:13.361971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a1ab7-a803-4dee-b881-82832a4cbbd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:13.363597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a1ab7-a803-4dee-b881-82832a4cbbd4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:13.473416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 100/206] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:13.479177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a8ee9-2ac2-42c2-aa29-396b26f18224 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:13.609698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a8ee9-2ac2-42c2-aa29-396b26f18224 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:13.642781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15672a1-a28a-40d9-98bc-419ac6beb784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:13.643552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15672a1-a28a-40d9-98bc-419ac6beb784 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:13.643824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15672a1-a28a-40d9-98bc-419ac6beb784 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:13.644089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15672a1-a28a-40d9-98bc-419ac6beb784 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:13.645264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15672a1-a28a-40d9-98bc-419ac6beb784 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:13.646741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15672a1-a28a-40d9-98bc-419ac6beb784 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:13.648721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 107/207] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:13 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:13.654476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a1ab7-a803-4dee-b881-82832a4cbbd4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:13.800703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a1ab7-a803-4dee-b881-82832a4cbbd4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:13.843814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c28f2-96fc-405e-9098-ad48e7980193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:13.844476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c28f2-96fc-405e-9098-ad48e7980193 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:13.844761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c28f2-96fc-405e-9098-ad48e7980193 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:13.845088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c28f2-96fc-405e-9098-ad48e7980193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:13.846717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c28f2-96fc-405e-9098-ad48e7980193 None admin] RBAC: Adding query filter params (role.id=b7d83811a60b4a6da03617d631508e1b, scope.project.id=40b91b4949b0461a99311b62cd96aa7a, user.id=4d8ff1adf571485e9d5a77b8f2a20ed2) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:13.847033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c28f2-96fc-405e-9098-ad48e7980193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:13.848481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c28f2-96fc-405e-9098-ad48e7980193 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:13.858763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 101/208] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:13 2022] GET /identity/v3/role_assignments?user.id=4d8ff1adf571485e9d5a77b8f2a20ed2&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=b7d83811a60b4a6da03617d631508e1b => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:14.924213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88958f-0425-4e5e-858d-ce205d115a9e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:14.924726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88958f-0425-4e5e-858d-ce205d115a9e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:14.924835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88958f-0425-4e5e-858d-ce205d115a9e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:14.926316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 108/209] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:14.931343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c464-3ade-441d-a67a-9ce662b34874 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:14.931741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c464-3ade-441d-a67a-9ce662b34874 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:14.931898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c464-3ade-441d-a67a-9ce662b34874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:14.948725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f136c464-3ade-441d-a67a-9ce662b34874 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:14.949899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f136c464-3ade-441d-a67a-9ce662b34874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:15.016709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 102/210] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:15.040032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88958f-0425-4e5e-858d-ce205d115a9e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:15.045786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6eaa6-5d31-4a49-95f8-d020089dc2b3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.046116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6eaa6-5d31-4a49-95f8-d020089dc2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.046376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6eaa6-5d31-4a49-95f8-d020089dc2b3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.048741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 103/211] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:15.054479 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec4d88-cd19-4bf7-af97-2d349cdbfeea None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.054820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec4d88-cd19-4bf7-af97-2d349cdbfeea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.055034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec4d88-cd19-4bf7-af97-2d349cdbfeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.072007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dfec4d88-cd19-4bf7-af97-2d349cdbfeea None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:15.073178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dfec4d88-cd19-4bf7-af97-2d349cdbfeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:15.140205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 104/212] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:15.161633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88958f-0425-4e5e-858d-ce205d115a9e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:15.165251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec4d88-cd19-4bf7-af97-2d349cdbfeea None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:15.207592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6ee84-2a94-4c04-85ba-79577bab2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:15.208580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6ee84-2a94-4c04-85ba-79577bab2e4c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.208860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6ee84-2a94-4c04-85ba-79577bab2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.209138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6ee84-2a94-4c04-85ba-79577bab2e4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.225165 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6ee84-2a94-4c04-85ba-79577bab2e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-57a6ee84-2a94-4c04-85ba-79577bab2e4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:15.235299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:15.236536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:15.237531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 109/213] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:15.238363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf920b-3d42-47e7-b139-8f3cd0afb100 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.238363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf920b-3d42-47e7-b139-8f3cd0afb100 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.238363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf920b-3d42-47e7-b139-8f3cd0afb100 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.239655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 110/214] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:15.244161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf920b-3d42-47e7-b139-8f3cd0afb100 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:15.268477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec4d88-cd19-4bf7-af97-2d349cdbfeea None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:15.300695 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae0e3-585d-4d51-8bb3-591f14f9da71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:15.301481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae0e3-585d-4d51-8bb3-591f14f9da71 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.301815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae0e3-585d-4d51-8bb3-591f14f9da71 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.302106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae0e3-585d-4d51-8bb3-591f14f9da71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.303280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae0e3-585d-4d51-8bb3-591f14f9da71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:15.304812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae0e3-585d-4d51-8bb3-591f14f9da71 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:15.306351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 105/215] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:15.310956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b476-be7d-4c1b-9dd8-28405b409bf6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.311247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b476-be7d-4c1b-9dd8-28405b409bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.311528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b476-be7d-4c1b-9dd8-28405b409bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.327324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0d20b476-be7d-4c1b-9dd8-28405b409bf6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:15.328515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d20b476-be7d-4c1b-9dd8-28405b409bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:15.348458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf920b-3d42-47e7-b139-8f3cd0afb100 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:15.383476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49c297-3f10-42c4-bc35-d6c8ec48caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:15.384143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49c297-3f10-42c4-bc35-d6c8ec48caa5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.384428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49c297-3f10-42c4-bc35-d6c8ec48caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.384718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49c297-3f10-42c4-bc35-d6c8ec48caa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.385457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49c297-3f10-42c4-bc35-d6c8ec48caa5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:15.385766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49c297-3f10-42c4-bc35-d6c8ec48caa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:15.387198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49c297-3f10-42c4-bc35-d6c8ec48caa5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:15.394078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 106/216] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:15.394901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20b476-be7d-4c1b-9dd8-28405b409bf6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:15.401257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 111/217] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:15.402366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49c297-3f10-42c4-bc35-d6c8ec48caa5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:15.495856 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20b476-be7d-4c1b-9dd8-28405b409bf6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:15.505585 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49c297-3f10-42c4-bc35-d6c8ec48caa5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:15.531312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c507a-6aac-461f-a73a-bc1e53f24fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:15.531984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c507a-6aac-461f-a73a-bc1e53f24fe6 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.532263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c507a-6aac-461f-a73a-bc1e53f24fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.533071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c507a-6aac-461f-a73a-bc1e53f24fe6 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.533780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c507a-6aac-461f-a73a-bc1e53f24fe6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:15.535252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c507a-6aac-461f-a73a-bc1e53f24fe6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:15.542929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde8e36-bc38-4203-afdb-58e01c44cfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:15.543828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde8e36-bc38-4203-afdb-58e01c44cfea None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.544108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde8e36-bc38-4203-afdb-58e01c44cfea None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.544377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde8e36-bc38-4203-afdb-58e01c44cfea None admin] PATH_INFO: `/v3/users/bc2fa9aca5804ed9914de7cbf5129651` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.556071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 107/218] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:15 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:15.559026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde8e36-bc38-4203-afdb-58e01c44cfea None admin] RBAC: Authorizing `identity:get_user(user_id=bc2fa9aca5804ed9914de7cbf5129651)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:15.560517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde8e36-bc38-4203-afdb-58e01c44cfea None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:15.567189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 112/219] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:15 2022] GET /identity/v3/users/bc2fa9aca5804ed9914de7cbf5129651 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:15.567390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c507a-6aac-461f-a73a-bc1e53f24fe6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:15.568020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde8e36-bc38-4203-afdb-58e01c44cfea None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:15.681347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde8e36-bc38-4203-afdb-58e01c44cfea None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:15.684235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c507a-6aac-461f-a73a-bc1e53f24fe6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:15.716805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbbc6d-a431-40fa-9114-f6af7de29e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:15.717901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbbc6d-a431-40fa-9114-f6af7de29e1e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.718251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbbc6d-a431-40fa-9114-f6af7de29e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.718471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbbc6d-a431-40fa-9114-f6af7de29e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.719830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b387974-dba9-41e3-bc6a-b8734b0519dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:15.721218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b387974-dba9-41e3-bc6a-b8734b0519dc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.721773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b387974-dba9-41e3-bc6a-b8734b0519dc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.722248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b387974-dba9-41e3-bc6a-b8734b0519dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.733089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b387974-dba9-41e3-bc6a-b8734b0519dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4b387974-dba9-41e3-bc6a-b8734b0519dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:15.741531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:15.742524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:15.743748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 108/220] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:28:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:15.746179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae0c18-112c-480c-9532-3cf6d66588ef None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.746670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae0c18-112c-480c-9532-3cf6d66588ef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.747858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae0c18-112c-480c-9532-3cf6d66588ef None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.749358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 109/221] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:15.750780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae0c18-112c-480c-9532-3cf6d66588ef None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:15.789431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbbc6d-a431-40fa-9114-f6af7de29e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:15.790947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbbc6d-a431-40fa-9114-f6af7de29e1e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:15.874789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae0c18-112c-480c-9532-3cf6d66588ef None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:15.894222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 113/222] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 15:28:15.895757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f76cf-229a-4e38-8405-8d852952b71d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.896185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f76cf-229a-4e38-8405-8d852952b71d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.896607 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f76cf-229a-4e38-8405-8d852952b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.914533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd1c98-e4dd-45c8-91ba-069276c20e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:15.915198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd1c98-e4dd-45c8-91ba-069276c20e1f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:15.915480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd1c98-e4dd-45c8-91ba-069276c20e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:15.915748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd1c98-e4dd-45c8-91ba-069276c20e1f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:15.916492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd1c98-e4dd-45c8-91ba-069276c20e1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:15.916791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd1c98-e4dd-45c8-91ba-069276c20e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:15.918455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd1c98-e4dd-45c8-91ba-069276c20e1f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:15.918570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ae8f76cf-229a-4e38-8405-8d852952b71d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:15.919502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ae8f76cf-229a-4e38-8405-8d852952b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:15.928192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 110/223] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:15.929252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd1c98-e4dd-45c8-91ba-069276c20e1f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:15.987919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 114/224] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:15.992070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f76cf-229a-4e38-8405-8d852952b71d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:16.031146 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd1c98-e4dd-45c8-91ba-069276c20e1f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:16.066984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07b133-38c9-4a47-ace0-e5ae344046be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:16.067849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07b133-38c9-4a47-ace0-e5ae344046be None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:16.068125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07b133-38c9-4a47-ace0-e5ae344046be None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:16.068448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07b133-38c9-4a47-ace0-e5ae344046be None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:16.069659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07b133-38c9-4a47-ace0-e5ae344046be None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:16.071521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07b133-38c9-4a47-ace0-e5ae344046be None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:16.072995 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 111/225] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:15 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:16.073673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07b133-38c9-4a47-ace0-e5ae344046be None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:16.128908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f76cf-229a-4e38-8405-8d852952b71d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:16.163727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a6bc8-d84c-4924-9555-aec9d9514cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:16.164599 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a6bc8-d84c-4924-9555-aec9d9514cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:16.164879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a6bc8-d84c-4924-9555-aec9d9514cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:16.165150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a6bc8-d84c-4924-9555-aec9d9514cf2 None admin] PATH_INFO: `/v3/users/c89b7e9057214915a36fb638e82eedcf` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:16.166513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a6bc8-d84c-4924-9555-aec9d9514cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=c89b7e9057214915a36fb638e82eedcf)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:16.168242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a6bc8-d84c-4924-9555-aec9d9514cf2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:16.170324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 115/226] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:15 2022] GET /identity/v3/users/c89b7e9057214915a36fb638e82eedcf => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:16.171557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a6bc8-d84c-4924-9555-aec9d9514cf2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:16.181751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07b133-38c9-4a47-ace0-e5ae344046be None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:16.215943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0652e1-6d97-4009-81dc-dcc33271edff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:16.216841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0652e1-6d97-4009-81dc-dcc33271edff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:16.217214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0652e1-6d97-4009-81dc-dcc33271edff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:16.217562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0652e1-6d97-4009-81dc-dcc33271edff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:16.230540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0652e1-6d97-4009-81dc-dcc33271edff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-0a0652e1-6d97-4009-81dc-dcc33271edff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:16.238846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:16.239732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:16.240543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 112/227] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:16.241186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0652e1-6d97-4009-81dc-dcc33271edff None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:16.286159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a6bc8-d84c-4924-9555-aec9d9514cf2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:16.319905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55361d-3d63-4926-9034-03c816ab3acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:16.320564 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55361d-3d63-4926-9034-03c816ab3acd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:16.320845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55361d-3d63-4926-9034-03c816ab3acd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:16.321123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55361d-3d63-4926-9034-03c816ab3acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:16.321957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55361d-3d63-4926-9034-03c816ab3acd None admin] RBAC: Adding query filter params (role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339, user.id=bc2fa9aca5804ed9914de7cbf5129651) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:16.322302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55361d-3d63-4926-9034-03c816ab3acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:16.323752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55361d-3d63-4926-9034-03c816ab3acd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:16.329377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 116/228] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:16 2022] GET /identity/v3/role_assignments?user.id=bc2fa9aca5804ed9914de7cbf5129651&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:16.334176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55361d-3d63-4926-9034-03c816ab3acd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:16.375194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0652e1-6d97-4009-81dc-dcc33271edff None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:16.441120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55361d-3d63-4926-9034-03c816ab3acd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:16.455393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b77269-73ef-4ac9-8647-b50b1995d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:16.456648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b77269-73ef-4ac9-8647-b50b1995d97d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:16.457141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b77269-73ef-4ac9-8647-b50b1995d97d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:16.457600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b77269-73ef-4ac9-8647-b50b1995d97d None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:16.462864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b77269-73ef-4ac9-8647-b50b1995d97d None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:16.464637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b77269-73ef-4ac9-8647-b50b1995d97d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:16.466751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 113/229] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:16 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:16.473234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b77269-73ef-4ac9-8647-b50b1995d97d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:16.485293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6846f-03b6-484d-96d4-f92a639003bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:16.486576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6846f-03b6-484d-96d4-f92a639003bd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:16.486858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6846f-03b6-484d-96d4-f92a639003bd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:16.487130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6846f-03b6-484d-96d4-f92a639003bd None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:16.487915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6846f-03b6-484d-96d4-f92a639003bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:16.488179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6846f-03b6-484d-96d4-f92a639003bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:16.489578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6846f-03b6-484d-96d4-f92a639003bd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:16.502073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 117/230] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:16.511114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6846f-03b6-484d-96d4-f92a639003bd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:16.615479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6846f-03b6-484d-96d4-f92a639003bd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:16.654513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9c17-dfed-4d22-8568-902a9483c1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:16.655386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9c17-dfed-4d22-8568-902a9483c1df None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:16.655662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9c17-dfed-4d22-8568-902a9483c1df None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:16.655931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9c17-dfed-4d22-8568-902a9483c1df None admin] PATH_INFO: `/v3/users/c89b7e9057214915a36fb638e82eedcf` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:16.657238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae9c17-dfed-4d22-8568-902a9483c1df None admin] RBAC: Authorizing `identity:get_user(user_id=c89b7e9057214915a36fb638e82eedcf)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:16.659292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae9c17-dfed-4d22-8568-902a9483c1df None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:16.661066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 118/231] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:16 2022] GET /identity/v3/users/c89b7e9057214915a36fb638e82eedcf => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:16.666780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9c17-dfed-4d22-8568-902a9483c1df None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:16.680665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b77269-73ef-4ac9-8647-b50b1995d97d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:16.744788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a11c2-0067-4c44-8147-d61765cfe2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:16.745688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a11c2-0067-4c44-8147-d61765cfe2b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:16.745964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a11c2-0067-4c44-8147-d61765cfe2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:16.746264 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a11c2-0067-4c44-8147-d61765cfe2b4 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/users/c89b7e9057214915a36fb638e82eedcf/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:16.750653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a11c2-0067-4c44-8147-d61765cfe2b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=29a57b0c3d11422d89bc7c255ab0b339, user_id=c89b7e9057214915a36fb638e82eedcf, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:16.752130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a11c2-0067-4c44-8147-d61765cfe2b4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:16.775454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 114/232] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:28:16 2022] PUT /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/users/c89b7e9057214915a36fb638e82eedcf/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:16.815722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9c17-dfed-4d22-8568-902a9483c1df None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:16.851166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19378c-407f-4522-a347-04428e19df8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:16.852051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19378c-407f-4522-a347-04428e19df8c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:16.852327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19378c-407f-4522-a347-04428e19df8c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:16.852595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19378c-407f-4522-a347-04428e19df8c None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:16.853930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19378c-407f-4522-a347-04428e19df8c None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:16.855438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19378c-407f-4522-a347-04428e19df8c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:16.857200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 119/233] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:16 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:16.863317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a11c2-0067-4c44-8147-d61765cfe2b4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:16.992728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a11c2-0067-4c44-8147-d61765cfe2b4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:17.032050 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b1ab-ecff-48a0-a247-cbe8d00602c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:17.034284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b1ab-ecff-48a0-a247-cbe8d00602c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:17.034782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b1ab-ecff-48a0-a247-cbe8d00602c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:17.035245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b1ab-ecff-48a0-a247-cbe8d00602c9 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/users/c89b7e9057214915a36fb638e82eedcf/roles/552d2ed1429f43ac91cee158ee03be96` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:17.037680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b1ab-ecff-48a0-a247-cbe8d00602c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=29a57b0c3d11422d89bc7c255ab0b339, user_id=c89b7e9057214915a36fb638e82eedcf, role_id=552d2ed1429f43ac91cee158ee03be96)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:17.039356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b1ab-ecff-48a0-a247-cbe8d00602c9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:17.055105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 115/234] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:28:16 2022] PUT /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/users/c89b7e9057214915a36fb638e82eedcf/roles/552d2ed1429f43ac91cee158ee03be96 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:18.311434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25816f5-4f36-4bd4-8574-423a52dd410c None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:18.312445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25816f5-4f36-4bd4-8574-423a52dd410c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:18.312921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25816f5-4f36-4bd4-8574-423a52dd410c None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:18.314636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 120/235] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:18.320296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbc3f-11fc-43ed-8e49-d201989a5634 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:18.321114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbc3f-11fc-43ed-8e49-d201989a5634 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:18.321581 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbc3f-11fc-43ed-8e49-d201989a5634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:18.341684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-360cbc3f-11fc-43ed-8e49-d201989a5634 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:18.343195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-360cbc3f-11fc-43ed-8e49-d201989a5634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:18.426429 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 116/236] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:18.472597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc2cb-3a74-4ad2-ba6e-9bfb06c05565 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:18.473033 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc2cb-3a74-4ad2-ba6e-9bfb06c05565 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:18.473309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc2cb-3a74-4ad2-ba6e-9bfb06c05565 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:18.473681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbc3f-11fc-43ed-8e49-d201989a5634 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:18.475460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 121/237] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:18.480272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e73d2-b55c-46f8-9914-3f73c6556dcc None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:18.480797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e73d2-b55c-46f8-9914-3f73c6556dcc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:18.481277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e73d2-b55c-46f8-9914-3f73c6556dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:18.508875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-182e73d2-b55c-46f8-9914-3f73c6556dcc None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:18.510808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-182e73d2-b55c-46f8-9914-3f73c6556dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:18.619273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 122/238] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:18.626693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbc3f-11fc-43ed-8e49-d201989a5634 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:18.671104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e73d2-b55c-46f8-9914-3f73c6556dcc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:18.692949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218161-9111-4d0d-811f-e63609039e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:18.693677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218161-9111-4d0d-811f-e63609039e37 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:18.693957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218161-9111-4d0d-811f-e63609039e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:18.694259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218161-9111-4d0d-811f-e63609039e37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:18.706302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30218161-9111-4d0d-811f-e63609039e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-30218161-9111-4d0d-811f-e63609039e37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:18.714487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:18.715392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:18.716196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 117/239] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:18.726936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218161-9111-4d0d-811f-e63609039e37 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:18.793434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e73d2-b55c-46f8-9914-3f73c6556dcc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:18.847740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ab54a-1060-4a1e-87ff-1858df6d9612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:18.848975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ab54a-1060-4a1e-87ff-1858df6d9612 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:18.849473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ab54a-1060-4a1e-87ff-1858df6d9612 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:18.849947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ab54a-1060-4a1e-87ff-1858df6d9612 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:18.854883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ab54a-1060-4a1e-87ff-1858df6d9612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:18.855780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218161-9111-4d0d-811f-e63609039e37 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:18.856385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ab54a-1060-4a1e-87ff-1858df6d9612 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:18.858427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 123/240] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:18.867398 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ab54a-1060-4a1e-87ff-1858df6d9612 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:18.895436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b805b-7978-4d94-b6fa-30af4a1a2cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:18.896110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b805b-7978-4d94-b6fa-30af4a1a2cdf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:18.896391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b805b-7978-4d94-b6fa-30af4a1a2cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:18.896667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b805b-7978-4d94-b6fa-30af4a1a2cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:18.897408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b805b-7978-4d94-b6fa-30af4a1a2cdf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:18.897711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b805b-7978-4d94-b6fa-30af4a1a2cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:18.899174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b805b-7978-4d94-b6fa-30af4a1a2cdf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:18.908187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 118/241] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:18.913395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b805b-7978-4d94-b6fa-30af4a1a2cdf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:19.011480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b805b-7978-4d94-b6fa-30af4a1a2cdf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:19.044979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ab54a-1060-4a1e-87ff-1858df6d9612 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:19.045293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5605911-fb75-4652-94ee-3d0882ff4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:19.046195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5605911-fb75-4652-94ee-3d0882ff4f67 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.046473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5605911-fb75-4652-94ee-3d0882ff4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.046747 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5605911-fb75-4652-94ee-3d0882ff4f67 None admin] PATH_INFO: `/v3/users/ef58caed99294f489c0d4dc3c8b7c0a1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.059926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5605911-fb75-4652-94ee-3d0882ff4f67 None admin] RBAC: Authorizing `identity:get_user(user_id=ef58caed99294f489c0d4dc3c8b7c0a1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:19.061390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5605911-fb75-4652-94ee-3d0882ff4f67 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:19.063299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 119/242] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:18 2022] GET /identity/v3/users/ef58caed99294f489c0d4dc3c8b7c0a1 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:19.064354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28367485-29c0-4049-ae2e-14489fddc5f1 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.064637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28367485-29c0-4049-ae2e-14489fddc5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.064910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28367485-29c0-4049-ae2e-14489fddc5f1 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.070302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 120/243] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:19.071919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28367485-29c0-4049-ae2e-14489fddc5f1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:19.088007 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c27f0-c116-4ea8-b9b2-9c94486fa5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:19.089257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c27f0-c116-4ea8-b9b2-9c94486fa5ee None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.089742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c27f0-c116-4ea8-b9b2-9c94486fa5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.090404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c27f0-c116-4ea8-b9b2-9c94486fa5ee None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.091673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c27f0-c116-4ea8-b9b2-9c94486fa5ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:19.093724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c27f0-c116-4ea8-b9b2-9c94486fa5ee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:19.119886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 124/244] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:18 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:28:19.135417 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47acb-046b-4d52-83d4-4fcd84085253 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.136078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47acb-046b-4d52-83d4-4fcd84085253 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.136587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47acb-046b-4d52-83d4-4fcd84085253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.178340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-66d47acb-046b-4d52-83d4-4fcd84085253 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:19.179912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-66d47acb-046b-4d52-83d4-4fcd84085253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:19.240241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28367485-29c0-4049-ae2e-14489fddc5f1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:19.277456 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc567d1-00d1-4549-bec3-e84864ee5608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:19.278518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc567d1-00d1-4549-bec3-e84864ee5608 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.279077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc567d1-00d1-4549-bec3-e84864ee5608 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.279577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc567d1-00d1-4549-bec3-e84864ee5608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.353036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc567d1-00d1-4549-bec3-e84864ee5608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:19.353673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 125/245] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:19.362037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc567d1-00d1-4549-bec3-e84864ee5608 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:19.387252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47acb-046b-4d52-83d4-4fcd84085253 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:19.472551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 121/246] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:19.478333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc567d1-00d1-4549-bec3-e84864ee5608 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:19.503209 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47acb-046b-4d52-83d4-4fcd84085253 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:19.538827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a981-6af4-471c-b67d-03a1a4382133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:19.539546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a981-6af4-471c-b67d-03a1a4382133 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.539831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a981-6af4-471c-b67d-03a1a4382133 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.540206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a981-6af4-471c-b67d-03a1a4382133 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.553135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20a981-6af4-471c-b67d-03a1a4382133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ef20a981-6af4-471c-b67d-03a1a4382133 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:19.560894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:19.561790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:19.562601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 126/247] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:19.567842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a981-6af4-471c-b67d-03a1a4382133 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:19.583481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc567d1-00d1-4549-bec3-e84864ee5608 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:19.618280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237afb1-51b2-4f58-8bca-d1ce288cfe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:19.619482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237afb1-51b2-4f58-8bca-d1ce288cfe44 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.619976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237afb1-51b2-4f58-8bca-d1ce288cfe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.620438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237afb1-51b2-4f58-8bca-d1ce288cfe44 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.621959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237afb1-51b2-4f58-8bca-d1ce288cfe44 None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:19.623725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237afb1-51b2-4f58-8bca-d1ce288cfe44 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:19.625973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 122/248] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:19 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:19.631703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f6c35-0b14-4e08-9c5b-2ab40a0373d8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.631996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f6c35-0b14-4e08-9c5b-2ab40a0373d8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.632273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f6c35-0b14-4e08-9c5b-2ab40a0373d8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.633767 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 123/249] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:19.634350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f6c35-0b14-4e08-9c5b-2ab40a0373d8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:19.675587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a981-6af4-471c-b67d-03a1a4382133 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:19.713632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385003d-9aec-4720-9df3-522f8cf1cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:19.714342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385003d-9aec-4720-9df3-522f8cf1cf15 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.714627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385003d-9aec-4720-9df3-522f8cf1cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.714904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385003d-9aec-4720-9df3-522f8cf1cf15 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.715732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385003d-9aec-4720-9df3-522f8cf1cf15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:19.716040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385003d-9aec-4720-9df3-522f8cf1cf15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:19.717508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385003d-9aec-4720-9df3-522f8cf1cf15 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:19.727659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 127/250] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:19.732055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ee8bf-8182-4b51-9e92-f86c68250ad6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.732661 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ee8bf-8182-4b51-9e92-f86c68250ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.734335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ee8bf-8182-4b51-9e92-f86c68250ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.759925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d28ee8bf-8182-4b51-9e92-f86c68250ad6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:19.761963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d28ee8bf-8182-4b51-9e92-f86c68250ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:19.781334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f6c35-0b14-4e08-9c5b-2ab40a0373d8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:19.824651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42240c-6af4-4e39-b271-a8b707b3ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:19.825303 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42240c-6af4-4e39-b271-a8b707b3ec26 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:19.825585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42240c-6af4-4e39-b271-a8b707b3ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:19.825863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42240c-6af4-4e39-b271-a8b707b3ec26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:19.827201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42240c-6af4-4e39-b271-a8b707b3ec26 None admin] RBAC: Adding query filter params (role.id=b7d83811a60b4a6da03617d631508e1b, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339, user.id=ef58caed99294f489c0d4dc3c8b7c0a1) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:19.827677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42240c-6af4-4e39-b271-a8b707b3ec26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:19.830031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42240c-6af4-4e39-b271-a8b707b3ec26 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:19.838686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 124/251] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:19 2022] GET /identity/v3/role_assignments?user.id=ef58caed99294f489c0d4dc3c8b7c0a1&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=b7d83811a60b4a6da03617d631508e1b => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:19.839512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42240c-6af4-4e39-b271-a8b707b3ec26 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:19.908115 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 128/252] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:19.949638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ee8bf-8182-4b51-9e92-f86c68250ad6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:19.970783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42240c-6af4-4e39-b271-a8b707b3ec26 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:20.022588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58746ebd-628c-4805-bcfb-601741c1a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:20.024005 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58746ebd-628c-4805-bcfb-601741c1a9fb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:20.024284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58746ebd-628c-4805-bcfb-601741c1a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:20.024555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58746ebd-628c-4805-bcfb-601741c1a9fb None admin] PATH_INFO: `/v3/users/bc2fa9aca5804ed9914de7cbf5129651` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:20.025785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58746ebd-628c-4805-bcfb-601741c1a9fb None admin] RBAC: Authorizing `identity:get_user(user_id=bc2fa9aca5804ed9914de7cbf5129651)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:20.027572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58746ebd-628c-4805-bcfb-601741c1a9fb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:20.030959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 125/253] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:19 2022] GET /identity/v3/users/bc2fa9aca5804ed9914de7cbf5129651 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:20.035323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58746ebd-628c-4805-bcfb-601741c1a9fb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:20.193293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ee8bf-8182-4b51-9e92-f86c68250ad6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:20.201906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58746ebd-628c-4805-bcfb-601741c1a9fb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:20.253014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b6244-e3dd-495f-b9d4-352615f1d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:20.256549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b6244-e3dd-495f-b9d4-352615f1d057 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:20.256844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b6244-e3dd-495f-b9d4-352615f1d057 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:20.257120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b6244-e3dd-495f-b9d4-352615f1d057 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:20.258862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415f136-c4cd-4151-9cd1-909c1afa90aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:20.260168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b6244-e3dd-495f-b9d4-352615f1d057 None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:20.261624 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b6244-e3dd-495f-b9d4-352615f1d057 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:20.262389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415f136-c4cd-4151-9cd1-909c1afa90aa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:20.262827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415f136-c4cd-4151-9cd1-909c1afa90aa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:20.263241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415f136-c4cd-4151-9cd1-909c1afa90aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:20.263356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 126/254] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:20 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:20.265015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1e7f9-246c-4109-abf3-3287a659a362 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:20.266098 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1e7f9-246c-4109-abf3-3287a659a362 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:20.267721 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1e7f9-246c-4109-abf3-3287a659a362 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:20.269783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 127/255] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:20.270500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1e7f9-246c-4109-abf3-3287a659a362 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:20.308944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415f136-c4cd-4151-9cd1-909c1afa90aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5415f136-c4cd-4151-9cd1-909c1afa90aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:20.333989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:20.334995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:20.335929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 129/256] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:28:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:20.337034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256f671-8dcd-4e2f-a958-58d7412bf325 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:20.337034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256f671-8dcd-4e2f-a958-58d7412bf325 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:20.337345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256f671-8dcd-4e2f-a958-58d7412bf325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:20.379952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6256f671-8dcd-4e2f-a958-58d7412bf325 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:20.381665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6256f671-8dcd-4e2f-a958-58d7412bf325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:20.507983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 130/257] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:20.508765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256f671-8dcd-4e2f-a958-58d7412bf325 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:20.554658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1e7f9-246c-4109-abf3-3287a659a362 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:20.610185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc8860-929e-4254-a1b0-21143401e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:20.617039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc8860-929e-4254-a1b0-21143401e393 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:20.617335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc8860-929e-4254-a1b0-21143401e393 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:20.617613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc8860-929e-4254-a1b0-21143401e393 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/users/bc2fa9aca5804ed9914de7cbf5129651/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:20.617713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256f671-8dcd-4e2f-a958-58d7412bf325 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:20.619663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc8860-929e-4254-a1b0-21143401e393 None admin] RBAC: Authorizing `identity:create_grant(project_id=29a57b0c3d11422d89bc7c255ab0b339, user_id=bc2fa9aca5804ed9914de7cbf5129651, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:20.621116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc8860-929e-4254-a1b0-21143401e393 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:20.655020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887a01-caa0-45f4-942a-227262bbc742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:20.656590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887a01-caa0-45f4-942a-227262bbc742 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:20.656872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887a01-caa0-45f4-942a-227262bbc742 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:20.657151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887a01-caa0-45f4-942a-227262bbc742 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:20.658203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64887a01-caa0-45f4-942a-227262bbc742 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:20.659074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64887a01-caa0-45f4-942a-227262bbc742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:20.662697 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 128/258] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:28:20 2022] PUT /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/users/bc2fa9aca5804ed9914de7cbf5129651/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:20.663520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc8860-929e-4254-a1b0-21143401e393 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:20.663767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64887a01-caa0-45f4-942a-227262bbc742 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:20.680924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 131/259] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:20.688231 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887a01-caa0-45f4-942a-227262bbc742 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:20.836485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc8860-929e-4254-a1b0-21143401e393 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:20.885918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887a01-caa0-45f4-942a-227262bbc742 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:20.912917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96382dcb-1b35-4827-aafe-142895912f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:20.913751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96382dcb-1b35-4827-aafe-142895912f40 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:20.914059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96382dcb-1b35-4827-aafe-142895912f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:20.914492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96382dcb-1b35-4827-aafe-142895912f40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:20.930820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96382dcb-1b35-4827-aafe-142895912f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-96382dcb-1b35-4827-aafe-142895912f40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:20.946773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:20.947708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:20.948511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:20.949786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 129/260] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:20.955213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96382dcb-1b35-4827-aafe-142895912f40 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:20.958764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc01e4-e166-481f-a426-e15a503049af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:20.959854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc01e4-e166-481f-a426-e15a503049af None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:20.960155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc01e4-e166-481f-a426-e15a503049af None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:20.960433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc01e4-e166-481f-a426-e15a503049af None admin] PATH_INFO: `/v3/users/c89b7e9057214915a36fb638e82eedcf` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:20.961649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc01e4-e166-481f-a426-e15a503049af None admin] RBAC: Authorizing `identity:get_user(user_id=c89b7e9057214915a36fb638e82eedcf)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:20.966613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc01e4-e166-481f-a426-e15a503049af None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:20.968673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 132/261] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:20 2022] GET /identity/v3/users/c89b7e9057214915a36fb638e82eedcf => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:20.975817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc01e4-e166-481f-a426-e15a503049af None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:21.069045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96382dcb-1b35-4827-aafe-142895912f40 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:21.103491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8990537-326f-4e09-b090-1d477f90a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:21.104077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990537-326f-4e09-b090-1d477f90a90b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:21.104362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990537-326f-4e09-b090-1d477f90a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:21.104636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990537-326f-4e09-b090-1d477f90a90b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:21.105385 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8990537-326f-4e09-b090-1d477f90a90b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:21.105694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8990537-326f-4e09-b090-1d477f90a90b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:21.107099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8990537-326f-4e09-b090-1d477f90a90b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:21.115403 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 130/262] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:21.120871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8990537-326f-4e09-b090-1d477f90a90b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:21.177615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc01e4-e166-481f-a426-e15a503049af None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:21.219032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8990537-326f-4e09-b090-1d477f90a90b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:21.253415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94620-7d12-4c9b-ba92-4dad8422ecff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:21.254436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94620-7d12-4c9b-ba92-4dad8422ecff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:21.254724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94620-7d12-4c9b-ba92-4dad8422ecff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:21.255008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94620-7d12-4c9b-ba92-4dad8422ecff None admin] PATH_INFO: `/v3/users/c89b7e9057214915a36fb638e82eedcf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:21.256317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94620-7d12-4c9b-ba92-4dad8422ecff None admin] RBAC: Authorizing `identity:get_user(user_id=c89b7e9057214915a36fb638e82eedcf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:21.257862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94620-7d12-4c9b-ba92-4dad8422ecff None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:21.260146 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 131/263] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:21 2022] GET /identity/v3/users/c89b7e9057214915a36fb638e82eedcf => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:21.260947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1d4f0-fc22-4fc2-8455-cce141bb571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:21.261862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1d4f0-fc22-4fc2-8455-cce141bb571a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:21.262370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1d4f0-fc22-4fc2-8455-cce141bb571a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:21.262831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1d4f0-fc22-4fc2-8455-cce141bb571a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:21.265532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94620-7d12-4c9b-ba92-4dad8422ecff None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:21.364755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94620-7d12-4c9b-ba92-4dad8422ecff None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:21.401948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1d4f0-fc22-4fc2-8455-cce141bb571a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:21.403445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1d4f0-fc22-4fc2-8455-cce141bb571a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:21.427799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012579-f28d-4ab8-9b24-53eb1f65c0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:21.428472 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012579-f28d-4ab8-9b24-53eb1f65c0db None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:21.428753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012579-f28d-4ab8-9b24-53eb1f65c0db None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:21.429027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012579-f28d-4ab8-9b24-53eb1f65c0db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:21.565625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012579-f28d-4ab8-9b24-53eb1f65c0db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:21.567146 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012579-f28d-4ab8-9b24-53eb1f65c0db None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:21.590951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 133/264] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:21.597225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1d4f0-fc22-4fc2-8455-cce141bb571a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:21.779225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1d4f0-fc22-4fc2-8455-cce141bb571a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:21.810224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 132/265] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 15:28:21.817777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012579-f28d-4ab8-9b24-53eb1f65c0db None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:21.872531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df9ca-07e8-4335-a5b0-b501b5606580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:21.873396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df9ca-07e8-4335-a5b0-b501b5606580 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:21.873672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df9ca-07e8-4335-a5b0-b501b5606580 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:21.873947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df9ca-07e8-4335-a5b0-b501b5606580 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:21.878695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7df9ca-07e8-4335-a5b0-b501b5606580 None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:21.880164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7df9ca-07e8-4335-a5b0-b501b5606580 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:21.881872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 134/266] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:21 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:21.887783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df9ca-07e8-4335-a5b0-b501b5606580 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:21.996021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012579-f28d-4ab8-9b24-53eb1f65c0db None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:22.040031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b82c3a-51c3-45c0-a473-0f4217da7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:22.041472 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b82c3a-51c3-45c0-a473-0f4217da7fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:22.042134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b82c3a-51c3-45c0-a473-0f4217da7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:22.042604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b82c3a-51c3-45c0-a473-0f4217da7fb0 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:22.043997 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b82c3a-51c3-45c0-a473-0f4217da7fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:22.045641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b82c3a-51c3-45c0-a473-0f4217da7fb0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:22.049261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 133/267] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:21 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:22.054730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b82c3a-51c3-45c0-a473-0f4217da7fb0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:22.117619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df9ca-07e8-4335-a5b0-b501b5606580 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:22.178851 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a3e19-f685-4227-8bc1-1f0e35991714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:22.179803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a3e19-f685-4227-8bc1-1f0e35991714 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:22.180089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a3e19-f685-4227-8bc1-1f0e35991714 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:22.180533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a3e19-f685-4227-8bc1-1f0e35991714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:22.181699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a3e19-f685-4227-8bc1-1f0e35991714 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339, user.id=c89b7e9057214915a36fb638e82eedcf) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:22.182027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a3e19-f685-4227-8bc1-1f0e35991714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:22.183496 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a3e19-f685-4227-8bc1-1f0e35991714 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:22.197853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 135/268] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:21 2022] GET /identity/v3/role_assignments?user.id=c89b7e9057214915a36fb638e82eedcf&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=cb77715547a14bae950f68513af00d30 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:22.273579 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b82c3a-51c3-45c0-a473-0f4217da7fb0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:22.323742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea222c-6728-4903-8ec8-5b46ba5afc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:22.324332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea222c-6728-4903-8ec8-5b46ba5afc8f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:22.324614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea222c-6728-4903-8ec8-5b46ba5afc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:22.324888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea222c-6728-4903-8ec8-5b46ba5afc8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:22.325740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea222c-6728-4903-8ec8-5b46ba5afc8f None admin] RBAC: Adding query filter params (role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339, user.id=c89b7e9057214915a36fb638e82eedcf) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:22.326069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea222c-6728-4903-8ec8-5b46ba5afc8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:22.327565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea222c-6728-4903-8ec8-5b46ba5afc8f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:22.339265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 134/269] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:22 2022] GET /identity/v3/role_assignments?user.id=c89b7e9057214915a36fb638e82eedcf&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:22.498508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0aa4-03c2-4965-a375-9a2d9b5d40f6 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:22.499016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0aa4-03c2-4965-a375-9a2d9b5d40f6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:22.499119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0aa4-03c2-4965-a375-9a2d9b5d40f6 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:22.500690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 136/270] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:22.506540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb907c80-9f58-4032-826c-74265861ddef None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:22.506834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb907c80-9f58-4032-826c-74265861ddef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:22.507116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb907c80-9f58-4032-826c-74265861ddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:22.531304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cb907c80-9f58-4032-826c-74265861ddef None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:22.533081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cb907c80-9f58-4032-826c-74265861ddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:22.622612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 135/271] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:22.658356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e0aa4-03c2-4965-a375-9a2d9b5d40f6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:22.786557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e0aa4-03c2-4965-a375-9a2d9b5d40f6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:22.825631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9577b8f-ea4e-4f97-8850-1bcc3f2ace09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:22.826463 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9577b8f-ea4e-4f97-8850-1bcc3f2ace09 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:22.826743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9577b8f-ea4e-4f97-8850-1bcc3f2ace09 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:22.827016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9577b8f-ea4e-4f97-8850-1bcc3f2ace09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:22.842141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9577b8f-ea4e-4f97-8850-1bcc3f2ace09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e9577b8f-ea4e-4f97-8850-1bcc3f2ace09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:22.850849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:22.851703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:22.852916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 137/272] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:22.858075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb907c80-9f58-4032-826c-74265861ddef None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:22.892539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc79fe-bdc3-4736-a7c7-be6eff1d6a1d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:22.892727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc79fe-bdc3-4736-a7c7-be6eff1d6a1d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:22.892991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc79fe-bdc3-4736-a7c7-be6eff1d6a1d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:22.897445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 138/273] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:22.903677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603284a8-a87a-44af-b160-d73671668393 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:22.903982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603284a8-a87a-44af-b160-d73671668393 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:22.904229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603284a8-a87a-44af-b160-d73671668393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:22.933300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-603284a8-a87a-44af-b160-d73671668393 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:22.934515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-603284a8-a87a-44af-b160-d73671668393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:23.000333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb907c80-9f58-4032-826c-74265861ddef None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:23.017230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 139/274] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:23.040611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603284a8-a87a-44af-b160-d73671668393 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:23.044531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b76abc-f872-47de-9655-36d5254a3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:23.045334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b76abc-f872-47de-9655-36d5254a3340 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.045714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b76abc-f872-47de-9655-36d5254a3340 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.046117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b76abc-f872-47de-9655-36d5254a3340 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.046975 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b76abc-f872-47de-9655-36d5254a3340 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:23.047382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b76abc-f872-47de-9655-36d5254a3340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:23.048982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b76abc-f872-47de-9655-36d5254a3340 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:23.060483 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 136/275] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:23.066088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b76abc-f872-47de-9655-36d5254a3340 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:23.152974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603284a8-a87a-44af-b160-d73671668393 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:23.169239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b76abc-f872-47de-9655-36d5254a3340 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:23.187197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b76430-9046-4402-93a5-7e980d3e5f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:23.189205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b76430-9046-4402-93a5-7e980d3e5f85 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.189712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b76430-9046-4402-93a5-7e980d3e5f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.190436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b76430-9046-4402-93a5-7e980d3e5f85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.192176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b76430-9046-4402-93a5-7e980d3e5f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:23.194274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b76430-9046-4402-93a5-7e980d3e5f85 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:23.196807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 140/276] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:23.198907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6193d5-8062-479c-8dc6-71ef7bb723ba None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.199267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6193d5-8062-479c-8dc6-71ef7bb723ba None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.199630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6193d5-8062-479c-8dc6-71ef7bb723ba None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.200983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 141/277] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:23.202313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6193d5-8062-479c-8dc6-71ef7bb723ba None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:23.205757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7d259-14ec-46cb-808e-36a11d09a0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:23.206855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d259-14ec-46cb-808e-36a11d09a0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.207139 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d259-14ec-46cb-808e-36a11d09a0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.207414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d259-14ec-46cb-808e-36a11d09a0c6 None admin] PATH_INFO: `/v3/users/a6e77ddbf2554dea86f3c05c70a987b1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.220882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7d259-14ec-46cb-808e-36a11d09a0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=a6e77ddbf2554dea86f3c05c70a987b1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:23.222707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7d259-14ec-46cb-808e-36a11d09a0c6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:23.224586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 137/278] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:23 2022] GET /identity/v3/users/a6e77ddbf2554dea86f3c05c70a987b1 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:23.230641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85b31-6eca-47c9-ba5d-089a7aa6e0b4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.230641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85b31-6eca-47c9-ba5d-089a7aa6e0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.230923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85b31-6eca-47c9-ba5d-089a7aa6e0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.247522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bbd85b31-6eca-47c9-ba5d-089a7aa6e0b4 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:23.248753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bbd85b31-6eca-47c9-ba5d-089a7aa6e0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:23.304541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6193d5-8062-479c-8dc6-71ef7bb723ba None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:23.314150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 138/279] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:23.315348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85b31-6eca-47c9-ba5d-089a7aa6e0b4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:23.340835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbec0a-49fe-40bf-9794-c84119710aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:23.341501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbec0a-49fe-40bf-9794-c84119710aad None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.341774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbec0a-49fe-40bf-9794-c84119710aad None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.342068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbec0a-49fe-40bf-9794-c84119710aad None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.342764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbec0a-49fe-40bf-9794-c84119710aad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:23.344194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbec0a-49fe-40bf-9794-c84119710aad None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:23.374193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 142/280] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:23 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:23.374193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbec0a-49fe-40bf-9794-c84119710aad None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:23.427908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85b31-6eca-47c9-ba5d-089a7aa6e0b4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:23.463772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94bb3e-c864-4143-ab0c-f29d118462c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:23.464429 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94bb3e-c864-4143-ab0c-f29d118462c7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.464878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94bb3e-c864-4143-ab0c-f29d118462c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.465296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94bb3e-c864-4143-ab0c-f29d118462c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.466308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94bb3e-c864-4143-ab0c-f29d118462c7 None admin] RBAC: Adding query filter params (role.id=77cf47a512e2416eb2126eb72db4f14b, user.id=a6e77ddbf2554dea86f3c05c70a987b1, scope.system=all) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:23.466762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94bb3e-c864-4143-ab0c-f29d118462c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:23.468389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94bb3e-c864-4143-ab0c-f29d118462c7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:23.481869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbec0a-49fe-40bf-9794-c84119710aad None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:23.482438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 139/281] 10.222.0.75 () {56 vars in 1308 bytes} [Tue May 17 15:28:23 2022] GET /identity/v3/role_assignments?user.id=a6e77ddbf2554dea86f3c05c70a987b1&scope.system=all&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:23.526924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1825c-d1ee-42be-9084-324571622934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:23.527759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1825c-d1ee-42be-9084-324571622934 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.528042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1825c-d1ee-42be-9084-324571622934 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.528377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1825c-d1ee-42be-9084-324571622934 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.541817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1825c-d1ee-42be-9084-324571622934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-b2c1825c-d1ee-42be-9084-324571622934 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:23.550702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:23.551674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:23.552916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 143/282] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:23.559911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94bb3e-c864-4143-ab0c-f29d118462c7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:23.669075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94bb3e-c864-4143-ab0c-f29d118462c7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:23.706151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41631f7-4aa6-47f4-86c3-5fae6a5103f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:23.706810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41631f7-4aa6-47f4-86c3-5fae6a5103f8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.707091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41631f7-4aa6-47f4-86c3-5fae6a5103f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.707359 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41631f7-4aa6-47f4-86c3-5fae6a5103f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.708161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41631f7-4aa6-47f4-86c3-5fae6a5103f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:23.708466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41631f7-4aa6-47f4-86c3-5fae6a5103f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:23.709836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41631f7-4aa6-47f4-86c3-5fae6a5103f8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:23.719331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 140/283] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:23.725794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1825c-d1ee-42be-9084-324571622934 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:23.744541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478076-0f10-4b67-94b4-19a1b5e8ac21 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.744834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478076-0f10-4b67-94b4-19a1b5e8ac21 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.745108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478076-0f10-4b67-94b4-19a1b5e8ac21 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.746524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 141/284] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:28:23.751864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231f05b-d323-4c27-af35-1c8da6f9ae81 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.752153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231f05b-d323-4c27-af35-1c8da6f9ae81 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.752432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231f05b-d323-4c27-af35-1c8da6f9ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.770900 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1231f05b-d323-4c27-af35-1c8da6f9ae81 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:23.772092 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1231f05b-d323-4c27-af35-1c8da6f9ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:23.855604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1825c-d1ee-42be-9084-324571622934 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:23.869350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 142/285] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:23.890321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb69067-ab26-4866-bf39-7b2c9dde82c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:23.892643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231f05b-d323-4c27-af35-1c8da6f9ae81 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:23.894267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb69067-ab26-4866-bf39-7b2c9dde82c9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:23.894583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb69067-ab26-4866-bf39-7b2c9dde82c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:23.894872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb69067-ab26-4866-bf39-7b2c9dde82c9 None admin] PATH_INFO: `/v3/users/ef58caed99294f489c0d4dc3c8b7c0a1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:23.896319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb69067-ab26-4866-bf39-7b2c9dde82c9 None admin] RBAC: Authorizing `identity:get_user(user_id=ef58caed99294f489c0d4dc3c8b7c0a1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:23.897800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb69067-ab26-4866-bf39-7b2c9dde82c9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:23.899831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 144/286] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:23 2022] GET /identity/v3/users/ef58caed99294f489c0d4dc3c8b7c0a1 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:23.904979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb69067-ab26-4866-bf39-7b2c9dde82c9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:24.020488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb69067-ab26-4866-bf39-7b2c9dde82c9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:24.028124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231f05b-d323-4c27-af35-1c8da6f9ae81 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:24.058574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810255-1af7-4931-9cfd-98d9e58d14fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:24.059943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810255-1af7-4931-9cfd-98d9e58d14fe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:24.060419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810255-1af7-4931-9cfd-98d9e58d14fe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:24.060934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810255-1af7-4931-9cfd-98d9e58d14fe None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:24.062336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3810255-1af7-4931-9cfd-98d9e58d14fe None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:24.064632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3810255-1af7-4931-9cfd-98d9e58d14fe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:24.066683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 145/287] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:23 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:24.072225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810255-1af7-4931-9cfd-98d9e58d14fe None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:24.105788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aba66-e712-44a0-a39b-c8c25926a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:24.108534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aba66-e712-44a0-a39b-c8c25926a698 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:24.109637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aba66-e712-44a0-a39b-c8c25926a698 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:24.110166 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aba66-e712-44a0-a39b-c8c25926a698 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:24.122074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940aba66-e712-44a0-a39b-c8c25926a698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-940aba66-e712-44a0-a39b-c8c25926a698 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:24.131020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:24.131913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:24.132823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:24.136249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 143/288] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:24.144122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aba66-e712-44a0-a39b-c8c25926a698 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:24.218211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810255-1af7-4931-9cfd-98d9e58d14fe None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:24.255805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687be1da-8fba-449a-a292-c77953b8f435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:24.256839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687be1da-8fba-449a-a292-c77953b8f435 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:24.257216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687be1da-8fba-449a-a292-c77953b8f435 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:24.257584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687be1da-8fba-449a-a292-c77953b8f435 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/users/ef58caed99294f489c0d4dc3c8b7c0a1/roles/b7d83811a60b4a6da03617d631508e1b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:24.260138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687be1da-8fba-449a-a292-c77953b8f435 None admin] RBAC: Authorizing `identity:create_grant(project_id=29a57b0c3d11422d89bc7c255ab0b339, user_id=ef58caed99294f489c0d4dc3c8b7c0a1, role_id=b7d83811a60b4a6da03617d631508e1b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:24.261756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687be1da-8fba-449a-a292-c77953b8f435 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:24.311285 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 146/289] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:28:24 2022] PUT /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/users/ef58caed99294f489c0d4dc3c8b7c0a1/roles/b7d83811a60b4a6da03617d631508e1b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:28:24.334910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aba66-e712-44a0-a39b-c8c25926a698 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:24.373240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ee523-ae8d-4251-b67d-73d576ea01b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:24.373916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ee523-ae8d-4251-b67d-73d576ea01b5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:24.374295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ee523-ae8d-4251-b67d-73d576ea01b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:24.374570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ee523-ae8d-4251-b67d-73d576ea01b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:24.375385 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ee523-ae8d-4251-b67d-73d576ea01b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:24.375700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ee523-ae8d-4251-b67d-73d576ea01b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:24.377189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ee523-ae8d-4251-b67d-73d576ea01b5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:24.386443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 144/290] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:24.392583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687be1da-8fba-449a-a292-c77953b8f435 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:24.517618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687be1da-8fba-449a-a292-c77953b8f435 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:24.553402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff433e-a757-4de4-b25b-013d7a7c8b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:24.555068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff433e-a757-4de4-b25b-013d7a7c8b22 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:24.555613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff433e-a757-4de4-b25b-013d7a7c8b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:24.556088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff433e-a757-4de4-b25b-013d7a7c8b22 None admin] PATH_INFO: `/v3/users/bc2fa9aca5804ed9914de7cbf5129651` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:24.557622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff433e-a757-4de4-b25b-013d7a7c8b22 None admin] RBAC: Authorizing `identity:get_user(user_id=bc2fa9aca5804ed9914de7cbf5129651)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:24.559307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff433e-a757-4de4-b25b-013d7a7c8b22 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:24.561580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 147/291] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:24 2022] GET /identity/v3/users/bc2fa9aca5804ed9914de7cbf5129651 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:24.567973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ee523-ae8d-4251-b67d-73d576ea01b5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:24.670877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ee523-ae8d-4251-b67d-73d576ea01b5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:24.705827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43148657-3537-4e96-92a4-3e83f28b7024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:24.706818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43148657-3537-4e96-92a4-3e83f28b7024 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:24.707274 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43148657-3537-4e96-92a4-3e83f28b7024 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:24.707778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43148657-3537-4e96-92a4-3e83f28b7024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:24.777736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43148657-3537-4e96-92a4-3e83f28b7024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:24.779495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43148657-3537-4e96-92a4-3e83f28b7024 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:24.878985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 145/292] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:24.884772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff433e-a757-4de4-b25b-013d7a7c8b22 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:24.984861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff433e-a757-4de4-b25b-013d7a7c8b22 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:25.019520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2440d-4e43-4dc6-ba44-c05bb6ffbc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:25.020681 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2440d-4e43-4dc6-ba44-c05bb6ffbc2c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:25.021137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2440d-4e43-4dc6-ba44-c05bb6ffbc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:25.021586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2440d-4e43-4dc6-ba44-c05bb6ffbc2c None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:25.023027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2440d-4e43-4dc6-ba44-c05bb6ffbc2c None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:25.024833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2440d-4e43-4dc6-ba44-c05bb6ffbc2c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:25.027113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 148/293] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:24 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:25.033366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43148657-3537-4e96-92a4-3e83f28b7024 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:25.135298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43148657-3537-4e96-92a4-3e83f28b7024 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:25.169615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5a753-2f42-46d3-8649-3ac677b8519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:25.170299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5a753-2f42-46d3-8649-3ac677b8519e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:25.170577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5a753-2f42-46d3-8649-3ac677b8519e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:25.170849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5a753-2f42-46d3-8649-3ac677b8519e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:25.171692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5a753-2f42-46d3-8649-3ac677b8519e None admin] RBAC: Adding query filter params (role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339, user.id=bc2fa9aca5804ed9914de7cbf5129651) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:25.172001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5a753-2f42-46d3-8649-3ac677b8519e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:25.173982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5a753-2f42-46d3-8649-3ac677b8519e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:25.181045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 146/294] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:25 2022] GET /identity/v3/role_assignments?user.id=bc2fa9aca5804ed9914de7cbf5129651&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:26.041219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b2d40-369f-40ab-a893-d5b5609a5484 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.041739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b2d40-369f-40ab-a893-d5b5609a5484 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.041848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b2d40-369f-40ab-a893-d5b5609a5484 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.043158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 149/295] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:26.049051 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b40e-5732-464e-b843-e8c835f7c435 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.049503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b40e-5732-464e-b843-e8c835f7c435 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.049577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b40e-5732-464e-b843-e8c835f7c435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.067339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2742b40e-5732-464e-b843-e8c835f7c435 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:26.068569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2742b40e-5732-464e-b843-e8c835f7c435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:26.139760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 147/296] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:26.162342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b2d40-369f-40ab-a893-d5b5609a5484 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:26.272502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b2d40-369f-40ab-a893-d5b5609a5484 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:26.272826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5c3b-8336-4e3c-9d4c-a0be9fcafc48 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.273311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5c3b-8336-4e3c-9d4c-a0be9fcafc48 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.273782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5c3b-8336-4e3c-9d4c-a0be9fcafc48 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.275628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 148/297] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:28:26.280852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd842e-abe5-43f6-9051-b5f210e40a76 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.281397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd842e-abe5-43f6-9051-b5f210e40a76 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.281874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd842e-abe5-43f6-9051-b5f210e40a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.302290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e5dd842e-abe5-43f6-9051-b5f210e40a76 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:26.304332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e5dd842e-abe5-43f6-9051-b5f210e40a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:26.308373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c258a18-c933-45a7-a85e-5357a3481beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:26.309182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c258a18-c933-45a7-a85e-5357a3481beb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.309465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c258a18-c933-45a7-a85e-5357a3481beb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.309743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c258a18-c933-45a7-a85e-5357a3481beb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.325183 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c258a18-c933-45a7-a85e-5357a3481beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3c258a18-c933-45a7-a85e-5357a3481beb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:26.335375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:26.336256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:26.337061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 150/298] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:26.342775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c258a18-c933-45a7-a85e-5357a3481beb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:26.386022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 149/299] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:26.404380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd842e-abe5-43f6-9051-b5f210e40a76 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:26.450817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c258a18-c933-45a7-a85e-5357a3481beb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:26.488450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f0c1c-24b1-4e3e-afff-652717c06767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:26.489122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0c1c-24b1-4e3e-afff-652717c06767 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.489403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0c1c-24b1-4e3e-afff-652717c06767 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.489674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0c1c-24b1-4e3e-afff-652717c06767 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.490451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f0c1c-24b1-4e3e-afff-652717c06767 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:26.490755 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f0c1c-24b1-4e3e-afff-652717c06767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:26.492151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f0c1c-24b1-4e3e-afff-652717c06767 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:26.500584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 151/300] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:26.502589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e208fb-0e26-4a44-aebc-5aaf6e45e9fe None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.502881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e208fb-0e26-4a44-aebc-5aaf6e45e9fe None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.503157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e208fb-0e26-4a44-aebc-5aaf6e45e9fe None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.504532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 152/301] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:26.509380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e208fb-0e26-4a44-aebc-5aaf6e45e9fe None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:26.511396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd842e-abe5-43f6-9051-b5f210e40a76 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:26.548701 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fae92-b523-4033-8302-28bac11fe357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:26.549554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fae92-b523-4033-8302-28bac11fe357 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.549840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fae92-b523-4033-8302-28bac11fe357 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.550150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fae92-b523-4033-8302-28bac11fe357 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.561418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fae92-b523-4033-8302-28bac11fe357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ae4fae92-b523-4033-8302-28bac11fe357 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:26.569663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:26.570598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:26.571542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 150/302] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:26.576720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0242e5-da09-448e-af53-41f40f52dc2a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.577012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0242e5-da09-448e-af53-41f40f52dc2a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.577649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0242e5-da09-448e-af53-41f40f52dc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.593554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3c0242e5-da09-448e-af53-41f40f52dc2a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:26.594887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c0242e5-da09-448e-af53-41f40f52dc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:26.611828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e208fb-0e26-4a44-aebc-5aaf6e45e9fe None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:26.643614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c67e7-18cc-4589-84a4-1424df5c3b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:26.644504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c67e7-18cc-4589-84a4-1424df5c3b91 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.644785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c67e7-18cc-4589-84a4-1424df5c3b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.645057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c67e7-18cc-4589-84a4-1424df5c3b91 None admin] PATH_INFO: `/v3/users/a6e77ddbf2554dea86f3c05c70a987b1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.646282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c67e7-18cc-4589-84a4-1424df5c3b91 None admin] RBAC: Authorizing `identity:get_user(user_id=a6e77ddbf2554dea86f3c05c70a987b1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:26.647720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c67e7-18cc-4589-84a4-1424df5c3b91 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:26.653698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 153/303] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:26 2022] GET /identity/v3/users/a6e77ddbf2554dea86f3c05c70a987b1 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:26.653698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c67e7-18cc-4589-84a4-1424df5c3b91 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:26.664439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 151/304] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:26.665288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0242e5-da09-448e-af53-41f40f52dc2a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:26.764927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c67e7-18cc-4589-84a4-1424df5c3b91 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:26.766885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0242e5-da09-448e-af53-41f40f52dc2a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:26.798392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ab52d-2608-433f-a924-0d6ec12bf183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:26.799066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ab52d-2608-433f-a924-0d6ec12bf183 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.799347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ab52d-2608-433f-a924-0d6ec12bf183 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.799619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ab52d-2608-433f-a924-0d6ec12bf183 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.800351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ab52d-2608-433f-a924-0d6ec12bf183 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:26.800678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ab52d-2608-433f-a924-0d6ec12bf183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:26.802089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ab52d-2608-433f-a924-0d6ec12bf183 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:26.803602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2d161-a66b-4c3d-a264-b8a7966e5c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:26.805196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2d161-a66b-4c3d-a264-b8a7966e5c9a None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.805483 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2d161-a66b-4c3d-a264-b8a7966e5c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.805759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2d161-a66b-4c3d-a264-b8a7966e5c9a None admin] PATH_INFO: `/v3/system/users/a6e77ddbf2554dea86f3c05c70a987b1/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.807946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2d161-a66b-4c3d-a264-b8a7966e5c9a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6e77ddbf2554dea86f3c05c70a987b1, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:26.809689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2d161-a66b-4c3d-a264-b8a7966e5c9a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:26.810839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 154/305] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:26.811514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ab52d-2608-433f-a924-0d6ec12bf183 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:26.827710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 152/306] 10.222.0.75 () {58 vars in 1334 bytes} [Tue May 17 15:28:26 2022] PUT /identity/v3/system/users/a6e77ddbf2554dea86f3c05c70a987b1/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:26.829097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2d161-a66b-4c3d-a264-b8a7966e5c9a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:26.941966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2d161-a66b-4c3d-a264-b8a7966e5c9a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:26.947695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ab52d-2608-433f-a924-0d6ec12bf183 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:26.976819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c8b14-3900-44e7-9067-915e9ace16a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:26.977694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c8b14-3900-44e7-9067-915e9ace16a6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.977978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c8b14-3900-44e7-9067-915e9ace16a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.978290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c8b14-3900-44e7-9067-915e9ace16a6 None admin] PATH_INFO: `/v3/users/424068ab7b474dae86ad9e3308ebfc8e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.982292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9c9f7-4ca4-4e83-a860-27f599cf2f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:26.983324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9c9f7-4ca4-4e83-a860-27f599cf2f53 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.983745 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9c9f7-4ca4-4e83-a860-27f599cf2f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.984159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9c9f7-4ca4-4e83-a860-27f599cf2f53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.986165 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9c9f7-4ca4-4e83-a860-27f599cf2f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:26.987790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9c9f7-4ca4-4e83-a860-27f599cf2f53 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:26.989900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 155/307] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:26.991361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267205bc-ed8d-42d2-a277-3d31ddaedf04 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.991639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267205bc-ed8d-42d2-a277-3d31ddaedf04 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.991910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267205bc-ed8d-42d2-a277-3d31ddaedf04 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.993381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 156/308] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:26.998236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c8b14-3900-44e7-9067-915e9ace16a6 None admin] RBAC: Authorizing `identity:get_user(user_id=424068ab7b474dae86ad9e3308ebfc8e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:26.998821 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb069f9-4928-491f-85de-ab3dec776e92 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:26.999108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb069f9-4928-491f-85de-ab3dec776e92 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:26.999383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb069f9-4928-491f-85de-ab3dec776e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:26.999755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c8b14-3900-44e7-9067-915e9ace16a6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:27.001684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 153/309] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:26 2022] GET /identity/v3/users/424068ab7b474dae86ad9e3308ebfc8e => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:27.006531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c8b14-3900-44e7-9067-915e9ace16a6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:27.020467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2fb069f9-4928-491f-85de-ab3dec776e92 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:27.021653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2fb069f9-4928-491f-85de-ab3dec776e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:27.087083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 157/310] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:27.095458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb069f9-4928-491f-85de-ab3dec776e92 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:27.105738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c8b14-3900-44e7-9067-915e9ace16a6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:27.139542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1177f-b814-4b9e-89fe-e0959beb5f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:27.140226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1177f-b814-4b9e-89fe-e0959beb5f9d None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:27.140819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1177f-b814-4b9e-89fe-e0959beb5f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:27.140819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1177f-b814-4b9e-89fe-e0959beb5f9d None admin] PATH_INFO: `/v3/groups` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:27.141985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1177f-b814-4b9e-89fe-e0959beb5f9d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:27.143452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1177f-b814-4b9e-89fe-e0959beb5f9d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:27.165736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 154/311] 10.222.0.75 () {60 vars in 1134 bytes} [Tue May 17 15:28:27 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:27.165736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1177f-b814-4b9e-89fe-e0959beb5f9d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:27.202522 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb069f9-4928-491f-85de-ab3dec776e92 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:27.250686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375d814-2c77-4408-9606-f71dfff5b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:27.251441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375d814-2c77-4408-9606-f71dfff5b406 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:27.251718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375d814-2c77-4408-9606-f71dfff5b406 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:27.252031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375d814-2c77-4408-9606-f71dfff5b406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:27.252874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375d814-2c77-4408-9606-f71dfff5b406 None admin] RBAC: Adding query filter params (role.id=b7d83811a60b4a6da03617d631508e1b, user.id=424068ab7b474dae86ad9e3308ebfc8e, scope.system=all) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:27.253213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375d814-2c77-4408-9606-f71dfff5b406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:27.254681 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375d814-2c77-4408-9606-f71dfff5b406 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:27.260965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 158/312] 10.222.0.75 () {56 vars in 1308 bytes} [Tue May 17 15:28:27 2022] GET /identity/v3/role_assignments?user.id=424068ab7b474dae86ad9e3308ebfc8e&scope.system=all&role.id=b7d83811a60b4a6da03617d631508e1b => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:27.275804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1177f-b814-4b9e-89fe-e0959beb5f9d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:27.315543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec2b9-2440-4a06-8d9d-9fc1fae5d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:27.316360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec2b9-2440-4a06-8d9d-9fc1fae5d9ad None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:27.316641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec2b9-2440-4a06-8d9d-9fc1fae5d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:27.316912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec2b9-2440-4a06-8d9d-9fc1fae5d9ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:27.330270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec2b9-2440-4a06-8d9d-9fc1fae5d9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-691ec2b9-2440-4a06-8d9d-9fc1fae5d9ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:27.338331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:27.339261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:27.340061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 155/313] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:27.346589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375d814-2c77-4408-9606-f71dfff5b406 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:27.458034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375d814-2c77-4408-9606-f71dfff5b406 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:27.493315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee37fa-738a-441f-811c-3ad38e9915fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:27.493976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee37fa-738a-441f-811c-3ad38e9915fe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:27.494278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee37fa-738a-441f-811c-3ad38e9915fe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:27.494595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee37fa-738a-441f-811c-3ad38e9915fe None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:27.495396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee37fa-738a-441f-811c-3ad38e9915fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:27.495769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee37fa-738a-441f-811c-3ad38e9915fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:27.497189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee37fa-738a-441f-811c-3ad38e9915fe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:27.505484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 159/314] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:27.510714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec2b9-2440-4a06-8d9d-9fc1fae5d9ad None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:27.614752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec2b9-2440-4a06-8d9d-9fc1fae5d9ad None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:27.648265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ed262-b82b-41fc-baa0-f426a75274fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:27.649140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ed262-b82b-41fc-baa0-f426a75274fa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:27.649421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ed262-b82b-41fc-baa0-f426a75274fa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:27.649694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ed262-b82b-41fc-baa0-f426a75274fa None admin] PATH_INFO: `/v3/users/ef58caed99294f489c0d4dc3c8b7c0a1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:27.650937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ed262-b82b-41fc-baa0-f426a75274fa None admin] RBAC: Authorizing `identity:get_user(user_id=ef58caed99294f489c0d4dc3c8b7c0a1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:27.652392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ed262-b82b-41fc-baa0-f426a75274fa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:27.658103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 156/315] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:27 2022] GET /identity/v3/users/ef58caed99294f489c0d4dc3c8b7c0a1 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:27.660492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee37fa-738a-441f-811c-3ad38e9915fe None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:27.759042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee37fa-738a-441f-811c-3ad38e9915fe None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:27.791725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193981bd-1f00-44e6-9909-eb20f8479280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:27.792370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193981bd-1f00-44e6-9909-eb20f8479280 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:27.792647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193981bd-1f00-44e6-9909-eb20f8479280 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:27.792917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193981bd-1f00-44e6-9909-eb20f8479280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:27.865099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193981bd-1f00-44e6-9909-eb20f8479280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:27.866893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193981bd-1f00-44e6-9909-eb20f8479280 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:27.964965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 160/316] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:27.975251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ed262-b82b-41fc-baa0-f426a75274fa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:28.076545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ed262-b82b-41fc-baa0-f426a75274fa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:28.110953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0df99-e3bd-4001-81bf-8edb5d180fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:28.111816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0df99-e3bd-4001-81bf-8edb5d180fae None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:28.112099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0df99-e3bd-4001-81bf-8edb5d180fae None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:28.112376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0df99-e3bd-4001-81bf-8edb5d180fae None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:28.113573 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0df99-e3bd-4001-81bf-8edb5d180fae None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:28.115034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0df99-e3bd-4001-81bf-8edb5d180fae None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:28.121533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 157/317] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:27 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:28.122835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193981bd-1f00-44e6-9909-eb20f8479280 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:28.224149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193981bd-1f00-44e6-9909-eb20f8479280 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:28.257288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48651c3e-78c9-4b98-8019-d3c8f0739538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:28.257936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48651c3e-78c9-4b98-8019-d3c8f0739538 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:28.258246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48651c3e-78c9-4b98-8019-d3c8f0739538 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:28.258519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48651c3e-78c9-4b98-8019-d3c8f0739538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:28.259337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48651c3e-78c9-4b98-8019-d3c8f0739538 None admin] RBAC: Adding query filter params (role.id=b7d83811a60b4a6da03617d631508e1b, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339, user.id=ef58caed99294f489c0d4dc3c8b7c0a1) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:28.259646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48651c3e-78c9-4b98-8019-d3c8f0739538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:28.261078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48651c3e-78c9-4b98-8019-d3c8f0739538 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:28.274145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 161/318] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:28 2022] GET /identity/v3/role_assignments?user.id=ef58caed99294f489c0d4dc3c8b7c0a1&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=b7d83811a60b4a6da03617d631508e1b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:29.095360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bedd8-f773-4dbe-b510-df0fffba66fa None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.095771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bedd8-f773-4dbe-b510-df0fffba66fa None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.095944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bedd8-f773-4dbe-b510-df0fffba66fa None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.097535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 158/319] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:29.103232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310ce5e-772d-47cf-8aa4-c134afec8883 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.103518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310ce5e-772d-47cf-8aa4-c134afec8883 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.103789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310ce5e-772d-47cf-8aa4-c134afec8883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.119920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b310ce5e-772d-47cf-8aa4-c134afec8883 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:29.121100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b310ce5e-772d-47cf-8aa4-c134afec8883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:29.187190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 162/320] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:29.210478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bedd8-f773-4dbe-b510-df0fffba66fa None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:29.311957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bedd8-f773-4dbe-b510-df0fffba66fa None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:29.344750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d311bd-28fd-4b8d-9c6d-8c91de0b37d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:29.345592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d311bd-28fd-4b8d-9c6d-8c91de0b37d4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.345816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d311bd-28fd-4b8d-9c6d-8c91de0b37d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.346112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d311bd-28fd-4b8d-9c6d-8c91de0b37d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.355870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d311bd-28fd-4b8d-9c6d-8c91de0b37d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-85d311bd-28fd-4b8d-9c6d-8c91de0b37d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:29.364067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:29.364992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:29.365810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:29.367421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 159/321] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:29.371308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310ce5e-772d-47cf-8aa4-c134afec8883 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:29.467746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310ce5e-772d-47cf-8aa4-c134afec8883 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:29.481875 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a69438-e42c-4089-92d9-ad1448713890 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.482193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a69438-e42c-4089-92d9-ad1448713890 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.482469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a69438-e42c-4089-92d9-ad1448713890 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.483974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 160/322] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:28:29.488966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6afe5-da98-403b-9d63-70edb2ad1e5f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.489326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6afe5-da98-403b-9d63-70edb2ad1e5f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.489674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6afe5-da98-403b-9d63-70edb2ad1e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.501335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0754ab-8dbc-4369-a7eb-3bb7139d70ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:29.502663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0754ab-8dbc-4369-a7eb-3bb7139d70ac None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.503413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0754ab-8dbc-4369-a7eb-3bb7139d70ac None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.503860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0754ab-8dbc-4369-a7eb-3bb7139d70ac None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.504767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0754ab-8dbc-4369-a7eb-3bb7139d70ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:29.505238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0754ab-8dbc-4369-a7eb-3bb7139d70ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:29.506957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dda6afe5-da98-403b-9d63-70edb2ad1e5f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:29.507254 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0754ab-8dbc-4369-a7eb-3bb7139d70ac None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:29.508142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dda6afe5-da98-403b-9d63-70edb2ad1e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:29.517392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 163/323] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:29.523520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0754ab-8dbc-4369-a7eb-3bb7139d70ac None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:29.577306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 161/324] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:29.578642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f993d-ee44-4872-942a-926ed8fb2b75 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.579422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f993d-ee44-4872-942a-926ed8fb2b75 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.579695 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f993d-ee44-4872-942a-926ed8fb2b75 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.581194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 162/325] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:29.585791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965afe98-f3d4-4f40-8838-ef04316a4e10 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.586110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965afe98-f3d4-4f40-8838-ef04316a4e10 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.586394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965afe98-f3d4-4f40-8838-ef04316a4e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.604216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-965afe98-f3d4-4f40-8838-ef04316a4e10 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:29.605329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-965afe98-f3d4-4f40-8838-ef04316a4e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:29.624500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0754ab-8dbc-4369-a7eb-3bb7139d70ac None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:29.656549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8f46-fe54-4ae1-a423-16725ca93c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:29.657959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8f46-fe54-4ae1-a423-16725ca93c63 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.658265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8f46-fe54-4ae1-a423-16725ca93c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.658535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8f46-fe54-4ae1-a423-16725ca93c63 None admin] PATH_INFO: `/v3/users/a6e77ddbf2554dea86f3c05c70a987b1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.659779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e8f46-fe54-4ae1-a423-16725ca93c63 None admin] RBAC: Authorizing `identity:get_user(user_id=a6e77ddbf2554dea86f3c05c70a987b1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:29.661264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e8f46-fe54-4ae1-a423-16725ca93c63 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:29.662944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 164/326] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:29 2022] GET /identity/v3/users/a6e77ddbf2554dea86f3c05c70a987b1 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:29.666286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8f46-fe54-4ae1-a423-16725ca93c63 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:29.668589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 163/327] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:29.675221 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965afe98-f3d4-4f40-8838-ef04316a4e10 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:29.760485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8f46-fe54-4ae1-a423-16725ca93c63 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:29.762624 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965afe98-f3d4-4f40-8838-ef04316a4e10 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:29.791546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476426-febf-4570-a0a6-4ba07390d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:29.792324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476426-febf-4570-a0a6-4ba07390d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.792603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476426-febf-4570-a0a6-4ba07390d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.792881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476426-febf-4570-a0a6-4ba07390d8d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.794032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a476426-febf-4570-a0a6-4ba07390d8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:29.794163 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22782c37-584f-4c32-a2a2-ac5a9ed07021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:29.794807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22782c37-584f-4c32-a2a2-ac5a9ed07021 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.795089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22782c37-584f-4c32-a2a2-ac5a9ed07021 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.795365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22782c37-584f-4c32-a2a2-ac5a9ed07021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.795452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a476426-febf-4570-a0a6-4ba07390d8d0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:29.796186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22782c37-584f-4c32-a2a2-ac5a9ed07021 None admin] RBAC: Adding query filter params (role.id=77cf47a512e2416eb2126eb72db4f14b, user.id=a6e77ddbf2554dea86f3c05c70a987b1, scope.system=all) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:29.796497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22782c37-584f-4c32-a2a2-ac5a9ed07021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:29.797044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 165/328] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:29.797825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476426-febf-4570-a0a6-4ba07390d8d0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:29.797982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22782c37-584f-4c32-a2a2-ac5a9ed07021 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:29.814133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 164/329] 10.222.0.75 () {56 vars in 1308 bytes} [Tue May 17 15:28:29 2022] GET /identity/v3/role_assignments?user.id=a6e77ddbf2554dea86f3c05c70a987b1&scope.system=all&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 510 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:29.814953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22782c37-584f-4c32-a2a2-ac5a9ed07021 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:29.907673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476426-febf-4570-a0a6-4ba07390d8d0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:29.921348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22782c37-584f-4c32-a2a2-ac5a9ed07021 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:29.942140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaf881-896d-4ab5-aa5f-bf0c5bd7a03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:29.942961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaf881-896d-4ab5-aa5f-bf0c5bd7a03e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.943237 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaf881-896d-4ab5-aa5f-bf0c5bd7a03e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.943512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaf881-896d-4ab5-aa5f-bf0c5bd7a03e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.954855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eaf881-896d-4ab5-aa5f-bf0c5bd7a03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:29.956342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d1ed-eb46-41b9-8bcb-9105e969fc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:29.957014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d1ed-eb46-41b9-8bcb-9105e969fc08 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:29.957292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d1ed-eb46-41b9-8bcb-9105e969fc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:29.957562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d1ed-eb46-41b9-8bcb-9105e969fc08 None admin] PATH_INFO: `/v3/groups` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:29.958288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414d1ed-eb46-41b9-8bcb-9105e969fc08 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:29.959782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414d1ed-eb46-41b9-8bcb-9105e969fc08 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-46eaf881-896d-4ab5-aa5f-bf0c5bd7a03e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:29.962758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:29.963657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:29.964620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 166/330] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:29.970373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaf881-896d-4ab5-aa5f-bf0c5bd7a03e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:29.980785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 165/331] 10.222.0.75 () {60 vars in 1134 bytes} [Tue May 17 15:28:29 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:30.081539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaf881-896d-4ab5-aa5f-bf0c5bd7a03e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:30.116305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5a581-84d3-479d-ad01-765041662751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:30.116984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5a581-84d3-479d-ad01-765041662751 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:30.117263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5a581-84d3-479d-ad01-765041662751 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:30.117536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5a581-84d3-479d-ad01-765041662751 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:30.118326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5a581-84d3-479d-ad01-765041662751 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:30.118635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5a581-84d3-479d-ad01-765041662751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:30.120045 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5a581-84d3-479d-ad01-765041662751 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:30.128850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 167/332] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:30.134891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d1ed-eb46-41b9-8bcb-9105e969fc08 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:30.240963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d1ed-eb46-41b9-8bcb-9105e969fc08 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:30.277286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074e53e-78f5-48af-bb83-914781003c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:30.278625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e53e-78f5-48af-bb83-914781003c8b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:30.278625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e53e-78f5-48af-bb83-914781003c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:30.278808 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e53e-78f5-48af-bb83-914781003c8b None admin] PATH_INFO: `/v3/users/424068ab7b474dae86ad9e3308ebfc8e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:30.279918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074e53e-78f5-48af-bb83-914781003c8b None admin] RBAC: Authorizing `identity:get_user(user_id=424068ab7b474dae86ad9e3308ebfc8e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:30.281368 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074e53e-78f5-48af-bb83-914781003c8b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:30.283546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 166/333] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:30 2022] GET /identity/v3/users/424068ab7b474dae86ad9e3308ebfc8e => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:30.289063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5a581-84d3-479d-ad01-765041662751 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:30.388341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5a581-84d3-479d-ad01-765041662751 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:30.424041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad2cd0-3c47-4a8e-af78-68f3ad4165db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:30.424915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad2cd0-3c47-4a8e-af78-68f3ad4165db None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:30.425193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad2cd0-3c47-4a8e-af78-68f3ad4165db None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:30.425466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad2cd0-3c47-4a8e-af78-68f3ad4165db None admin] PATH_INFO: `/v3/system/users/424068ab7b474dae86ad9e3308ebfc8e/roles/b7d83811a60b4a6da03617d631508e1b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:30.427034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad2cd0-3c47-4a8e-af78-68f3ad4165db None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=424068ab7b474dae86ad9e3308ebfc8e, role_id=b7d83811a60b4a6da03617d631508e1b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:30.428428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad2cd0-3c47-4a8e-af78-68f3ad4165db None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:30.438662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 168/334] 10.222.0.75 () {58 vars in 1334 bytes} [Tue May 17 15:28:30 2022] PUT /identity/v3/system/users/424068ab7b474dae86ad9e3308ebfc8e/roles/b7d83811a60b4a6da03617d631508e1b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:32.614491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3351-fe35-4a8c-9b47-e515642104d1 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:32.615513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3351-fe35-4a8c-9b47-e515642104d1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:32.616016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3351-fe35-4a8c-9b47-e515642104d1 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:32.617841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 167/335] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:32.623457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aef8a-07fd-47af-93dd-1a53db1debae None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:32.624269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aef8a-07fd-47af-93dd-1a53db1debae None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:32.624756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aef8a-07fd-47af-93dd-1a53db1debae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:32.643625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-de4aef8a-07fd-47af-93dd-1a53db1debae None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:32.645150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-de4aef8a-07fd-47af-93dd-1a53db1debae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:32.720992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 169/336] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:32.759756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e3351-fe35-4a8c-9b47-e515642104d1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:32.870205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e3351-fe35-4a8c-9b47-e515642104d1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:32.911770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d255bfd-ece6-47f2-b06a-ddbe8aac90c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:32.912955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255bfd-ece6-47f2-b06a-ddbe8aac90c5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:32.913440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255bfd-ece6-47f2-b06a-ddbe8aac90c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:32.913914 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255bfd-ece6-47f2-b06a-ddbe8aac90c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:32.933416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d255bfd-ece6-47f2-b06a-ddbe8aac90c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3d255bfd-ece6-47f2-b06a-ddbe8aac90c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:32.942190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:32.943379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:32.944218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:32.947782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 168/337] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:32.953909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aef8a-07fd-47af-93dd-1a53db1debae None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:32.982202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76720-e835-4455-9b46-39ab31a28d32 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:32.982823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76720-e835-4455-9b46-39ab31a28d32 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:32.983336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76720-e835-4455-9b46-39ab31a28d32 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:32.984948 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 169/338] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:28:32.990698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeb10f-4483-4ad4-a367-7dabd132a86f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:32.991249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeb10f-4483-4ad4-a367-7dabd132a86f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:32.991731 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeb10f-4483-4ad4-a367-7dabd132a86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.015739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9bfeb10f-4483-4ad4-a367-7dabd132a86f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:33.017072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9bfeb10f-4483-4ad4-a367-7dabd132a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:33.085870 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aef8a-07fd-47af-93dd-1a53db1debae None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:33.112034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 170/339] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:33.124581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03a71-d14c-4ce5-a40c-3b9235c79569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:33.125574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03a71-d14c-4ce5-a40c-3b9235c79569 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.126085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03a71-d14c-4ce5-a40c-3b9235c79569 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.126559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03a71-d14c-4ce5-a40c-3b9235c79569 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.127507 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca03a71-d14c-4ce5-a40c-3b9235c79569 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:33.127997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca03a71-d14c-4ce5-a40c-3b9235c79569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:33.129596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca03a71-d14c-4ce5-a40c-3b9235c79569 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:33.140382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 170/340] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:33.146642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeb10f-4483-4ad4-a367-7dabd132a86f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:33.153760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03a71-d14c-4ce5-a40c-3b9235c79569 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:33.266596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03a71-d14c-4ce5-a40c-3b9235c79569 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:33.302742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e93d9-4e15-4955-810b-3a1eede7076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:33.303884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e93d9-4e15-4955-810b-3a1eede7076b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.304645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e93d9-4e15-4955-810b-3a1eede7076b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.305112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e93d9-4e15-4955-810b-3a1eede7076b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.310439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeb10f-4483-4ad4-a367-7dabd132a86f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:33.319428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e93d9-4e15-4955-810b-3a1eede7076b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ae8e93d9-4e15-4955-810b-3a1eede7076b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:33.329087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:33.330084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 15:28:33.330867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:33.333475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 171/341] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:33.343102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e93d9-4e15-4955-810b-3a1eede7076b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:33.363659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498606a9-c034-4978-9ded-7db5810790ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:33.364341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498606a9-c034-4978-9ded-7db5810790ad None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.364629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498606a9-c034-4978-9ded-7db5810790ad None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.364908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498606a9-c034-4978-9ded-7db5810790ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.448576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498606a9-c034-4978-9ded-7db5810790ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:33.449988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498606a9-c034-4978-9ded-7db5810790ad None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:33.514440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e93d9-4e15-4955-810b-3a1eede7076b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:33.556354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341787c-83cd-4da5-b80d-5b9e02bcac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:33.557392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341787c-83cd-4da5-b80d-5b9e02bcac7d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.557883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341787c-83cd-4da5-b80d-5b9e02bcac7d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.558370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341787c-83cd-4da5-b80d-5b9e02bcac7d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.558941 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 171/342] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:33.559545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341787c-83cd-4da5-b80d-5b9e02bcac7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:33.560049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341787c-83cd-4da5-b80d-5b9e02bcac7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:33.560351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9d855-4ce6-4ed4-86a7-9f41e101152b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.560645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9d855-4ce6-4ed4-86a7-9f41e101152b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.560926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9d855-4ce6-4ed4-86a7-9f41e101152b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.562229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 172/343] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:33.562488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341787c-83cd-4da5-b80d-5b9e02bcac7d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:33.566853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9d855-4ce6-4ed4-86a7-9f41e101152b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:33.574260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 172/344] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:33.575781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd142-86ad-4faf-87c4-98bd44b845b3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.576283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd142-86ad-4faf-87c4-98bd44b845b3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.576748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd142-86ad-4faf-87c4-98bd44b845b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.597448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-188dd142-86ad-4faf-87c4-98bd44b845b3 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:33.601991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-188dd142-86ad-4faf-87c4-98bd44b845b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:33.675714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 173/345] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:33.677315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd142-86ad-4faf-87c4-98bd44b845b3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:33.693888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9d855-4ce6-4ed4-86a7-9f41e101152b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:33.729222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f553-65bf-46ec-bdf4-c2fcf5456c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:33.731777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f553-65bf-46ec-bdf4-c2fcf5456c38 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.731777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f553-65bf-46ec-bdf4-c2fcf5456c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.731777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f553-65bf-46ec-bdf4-c2fcf5456c38 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.732017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f553-65bf-46ec-bdf4-c2fcf5456c38 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:33.733371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f553-65bf-46ec-bdf4-c2fcf5456c38 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:33.735743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 173/346] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:33 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:33.737333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2cb4-4eaf-45e4-992c-b156bf668a47 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.737333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2cb4-4eaf-45e4-992c-b156bf668a47 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.737517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2cb4-4eaf-45e4-992c-b156bf668a47 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.738778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 174/347] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:33.739467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c2cb4-4eaf-45e4-992c-b156bf668a47 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:33.784430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd142-86ad-4faf-87c4-98bd44b845b3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:33.820852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fcab3-38c3-49f2-8967-1f04aa843355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:33.822151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fcab3-38c3-49f2-8967-1f04aa843355 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.822654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fcab3-38c3-49f2-8967-1f04aa843355 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.823125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fcab3-38c3-49f2-8967-1f04aa843355 None admin] PATH_INFO: `/v3/users/424068ab7b474dae86ad9e3308ebfc8e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.826106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fcab3-38c3-49f2-8967-1f04aa843355 None admin] RBAC: Authorizing `identity:get_user(user_id=424068ab7b474dae86ad9e3308ebfc8e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:33.827893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fcab3-38c3-49f2-8967-1f04aa843355 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:33.830617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 174/348] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:28:33 2022] GET /identity/v3/users/424068ab7b474dae86ad9e3308ebfc8e => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:33.831589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fcab3-38c3-49f2-8967-1f04aa843355 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:33.873634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c2cb4-4eaf-45e4-992c-b156bf668a47 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:33.916469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f7e26-0e8b-4732-807a-c94af85e76d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:33.917268 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f7e26-0e8b-4732-807a-c94af85e76d9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.917548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f7e26-0e8b-4732-807a-c94af85e76d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.917820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f7e26-0e8b-4732-807a-c94af85e76d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.931926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f7e26-0e8b-4732-807a-c94af85e76d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-701f7e26-0e8b-4732-807a-c94af85e76d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:33.942384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:33.943292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:33.944122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 175/349] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:33.944799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e290390-0461-4e6b-8645-d2cfc6a43260 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.945618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e290390-0461-4e6b-8645-d2cfc6a43260 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.945618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e290390-0461-4e6b-8645-d2cfc6a43260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.953334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fcab3-38c3-49f2-8967-1f04aa843355 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:33.965096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1e290390-0461-4e6b-8645-d2cfc6a43260 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:33.966660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1e290390-0461-4e6b-8645-d2cfc6a43260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:33.991343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45ff66-833e-4a9b-8711-453675bbf56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:33.992132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45ff66-833e-4a9b-8711-453675bbf56b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:33.992414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45ff66-833e-4a9b-8711-453675bbf56b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:33.993403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45ff66-833e-4a9b-8711-453675bbf56b None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:33.999370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45ff66-833e-4a9b-8711-453675bbf56b None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:34.001425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45ff66-833e-4a9b-8711-453675bbf56b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:34.004762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 175/350] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:33 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:34.005271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45ff66-833e-4a9b-8711-453675bbf56b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:34.041583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 176/351] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:34.042812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e290390-0461-4e6b-8645-d2cfc6a43260 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:34.122573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45ff66-833e-4a9b-8711-453675bbf56b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:34.161773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e290390-0461-4e6b-8645-d2cfc6a43260 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:34.167665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0253759-f050-42c7-9687-789c69e510b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:34.168611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0253759-f050-42c7-9687-789c69e510b1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:34.169104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0253759-f050-42c7-9687-789c69e510b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:34.169624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0253759-f050-42c7-9687-789c69e510b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:34.170734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0253759-f050-42c7-9687-789c69e510b1 None admin] RBAC: Adding query filter params (role.id=b7d83811a60b4a6da03617d631508e1b, user.id=424068ab7b474dae86ad9e3308ebfc8e, scope.system=all) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:34.171238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0253759-f050-42c7-9687-789c69e510b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:34.174092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0253759-f050-42c7-9687-789c69e510b1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:34.191678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 176/352] 10.222.0.75 () {56 vars in 1308 bytes} [Tue May 17 15:28:34 2022] GET /identity/v3/role_assignments?user.id=424068ab7b474dae86ad9e3308ebfc8e&scope.system=all&role.id=b7d83811a60b4a6da03617d631508e1b => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:34.192808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0253759-f050-42c7-9687-789c69e510b1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:34.220082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9a015-f051-46eb-ae72-d846368e3686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:34.221422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a015-f051-46eb-ae72-d846368e3686 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:34.221846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a015-f051-46eb-ae72-d846368e3686 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:34.222286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a015-f051-46eb-ae72-d846368e3686 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:34.223439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a015-f051-46eb-ae72-d846368e3686 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:34.224433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a015-f051-46eb-ae72-d846368e3686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:34.226373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a015-f051-46eb-ae72-d846368e3686 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:34.244742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 177/353] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:34.246796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9a015-f051-46eb-ae72-d846368e3686 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:34.384715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0253759-f050-42c7-9687-789c69e510b1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:34.447880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4250f51-3076-4c37-b452-f71d6ecc6866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:34.448553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4250f51-3076-4c37-b452-f71d6ecc6866 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:34.449200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4250f51-3076-4c37-b452-f71d6ecc6866 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:34.449491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4250f51-3076-4c37-b452-f71d6ecc6866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:34.450586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4250f51-3076-4c37-b452-f71d6ecc6866 None admin] RBAC: Adding query filter params (group.id=0da97999d1af4d8db645ef8709636747, role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=40b91b4949b0461a99311b62cd96aa7a) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:34.450900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4250f51-3076-4c37-b452-f71d6ecc6866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:34.454291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4250f51-3076-4c37-b452-f71d6ecc6866 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:34.458518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9a015-f051-46eb-ae72-d846368e3686 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:34.464505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 177/354] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:34 2022] GET /identity/v3/role_assignments?group.id=0da97999d1af4d8db645ef8709636747&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:34.465337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4250f51-3076-4c37-b452-f71d6ecc6866 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:34.519949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c358d83-5c58-45da-825b-6a4bffff1d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:34.520691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c358d83-5c58-45da-825b-6a4bffff1d89 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:34.520972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c358d83-5c58-45da-825b-6a4bffff1d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:34.521248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c358d83-5c58-45da-825b-6a4bffff1d89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:34.543583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c358d83-5c58-45da-825b-6a4bffff1d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3c358d83-5c58-45da-825b-6a4bffff1d89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:34.552539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:34.553480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:34.554323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:34.560982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 178/355] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:34.561942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c358d83-5c58-45da-825b-6a4bffff1d89 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:34.668664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4250f51-3076-4c37-b452-f71d6ecc6866 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:34.717294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499155b-3b65-4f2e-9b79-e8dcb08f9ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:34.718064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499155b-3b65-4f2e-9b79-e8dcb08f9ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:34.718261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499155b-3b65-4f2e-9b79-e8dcb08f9ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:34.718538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499155b-3b65-4f2e-9b79-e8dcb08f9ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:34.730381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c358d83-5c58-45da-825b-6a4bffff1d89 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:34.771782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d57a01-a25a-43d8-9fea-044fc4e31f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:34.773146 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d57a01-a25a-43d8-9fea-044fc4e31f66 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:34.773648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d57a01-a25a-43d8-9fea-044fc4e31f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:34.774484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d57a01-a25a-43d8-9fea-044fc4e31f66 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:34.775787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d57a01-a25a-43d8-9fea-044fc4e31f66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:34.776274 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d57a01-a25a-43d8-9fea-044fc4e31f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:34.778698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d57a01-a25a-43d8-9fea-044fc4e31f66 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:34.792702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 179/356] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:34.795215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0efe95-8cab-4593-b0c9-3879a8e32c0d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:34.795724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0efe95-8cab-4593-b0c9-3879a8e32c0d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:34.796346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0efe95-8cab-4593-b0c9-3879a8e32c0d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:34.798856 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 180/357] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:34.799937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0efe95-8cab-4593-b0c9-3879a8e32c0d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:34.806329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499155b-3b65-4f2e-9b79-e8dcb08f9ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:34.807849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499155b-3b65-4f2e-9b79-e8dcb08f9ae0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:34.921351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0efe95-8cab-4593-b0c9-3879a8e32c0d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:34.938775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 178/358] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:34.940194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab515e-cc8e-4bf1-8e9d-f1bf633bfcfa None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:34.940194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab515e-cc8e-4bf1-8e9d-f1bf633bfcfa None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:34.940386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab515e-cc8e-4bf1-8e9d-f1bf633bfcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:34.965418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dfab515e-cc8e-4bf1-8e9d-f1bf633bfcfa None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:34.966996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dfab515e-cc8e-4bf1-8e9d-f1bf633bfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:34.982821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31311877-329e-48d7-960d-d92fe8ed317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:34.984055 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311877-329e-48d7-960d-d92fe8ed317c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:34.984562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311877-329e-48d7-960d-d92fe8ed317c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:34.985143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311877-329e-48d7-960d-d92fe8ed317c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.045701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 179/359] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:35.048282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab515e-cc8e-4bf1-8e9d-f1bf633bfcfa None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.062739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31311877-329e-48d7-960d-d92fe8ed317c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:35.064724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31311877-329e-48d7-960d-d92fe8ed317c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:35.174861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab515e-cc8e-4bf1-8e9d-f1bf633bfcfa None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:35.205692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 181/360] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:35.207150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c927d6-a0c9-4ef7-87e2-0413a722f12d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.207439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c927d6-a0c9-4ef7-87e2-0413a722f12d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.207716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c927d6-a0c9-4ef7-87e2-0413a722f12d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.209151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 182/361] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:35.209684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c927d6-a0c9-4ef7-87e2-0413a722f12d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.217097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ad09c-455a-4db3-ab75-48579819f824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:35.217574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ad09c-455a-4db3-ab75-48579819f824 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.217692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ad09c-455a-4db3-ab75-48579819f824 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.217973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ad09c-455a-4db3-ab75-48579819f824 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.221818 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ad09c-455a-4db3-ab75-48579819f824 None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:35.221818 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ad09c-455a-4db3-ab75-48579819f824 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:35.223088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 180/362] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:35.223853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ad09c-455a-4db3-ab75-48579819f824 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.344738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ad09c-455a-4db3-ab75-48579819f824 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:35.353336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c927d6-a0c9-4ef7-87e2-0413a722f12d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:35.392958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25ce63-ca66-4e1e-be15-8ba8c8357730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:35.393768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ce63-ca66-4e1e-be15-8ba8c8357730 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.394091 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ce63-ca66-4e1e-be15-8ba8c8357730 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.394195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484eead-2ffa-4a2b-8ae5-23c3eaf334a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:35.394369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ce63-ca66-4e1e-be15-8ba8c8357730 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.394933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484eead-2ffa-4a2b-8ae5-23c3eaf334a4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.395171 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484eead-2ffa-4a2b-8ae5-23c3eaf334a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.395444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484eead-2ffa-4a2b-8ae5-23c3eaf334a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.395550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25ce63-ca66-4e1e-be15-8ba8c8357730 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:35.397014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25ce63-ca66-4e1e-be15-8ba8c8357730 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:35.400080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 181/363] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:35.401309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d62a-74ee-49c3-bee5-ea97afa9d751 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.401595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d62a-74ee-49c3-bee5-ea97afa9d751 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.403829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d62a-74ee-49c3-bee5-ea97afa9d751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.410991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484eead-2ffa-4a2b-8ae5-23c3eaf334a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8484eead-2ffa-4a2b-8ae5-23c3eaf334a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:35.420024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:35.420954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:35.421809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:35.423025 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b514d62a-74ee-49c3-bee5-ea97afa9d751 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:35.423106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 183/364] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:35.423106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484eead-2ffa-4a2b-8ae5-23c3eaf334a4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.423237 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b514d62a-74ee-49c3-bee5-ea97afa9d751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:35.514022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 182/365] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:35.514022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d62a-74ee-49c3-bee5-ea97afa9d751 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.553172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484eead-2ffa-4a2b-8ae5-23c3eaf334a4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:35.600529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7667f-5eae-4849-b0b6-fe7974a9df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:35.601795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7667f-5eae-4849-b0b6-fe7974a9df0c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.602429 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7667f-5eae-4849-b0b6-fe7974a9df0c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.602716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7667f-5eae-4849-b0b6-fe7974a9df0c None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.604383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7667f-5eae-4849-b0b6-fe7974a9df0c None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:35.606052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7667f-5eae-4849-b0b6-fe7974a9df0c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:35.608115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 184/366] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:35.609179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7667f-5eae-4849-b0b6-fe7974a9df0c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.625652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d62a-74ee-49c3-bee5-ea97afa9d751 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:35.663371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1335-96a7-444d-9303-bba45aaf7614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:35.664610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1335-96a7-444d-9303-bba45aaf7614 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.665273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1335-96a7-444d-9303-bba45aaf7614 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.665736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1335-96a7-444d-9303-bba45aaf7614 None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.668127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b1335-96a7-444d-9303-bba45aaf7614 None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:35.669898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b1335-96a7-444d-9303-bba45aaf7614 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:35.672061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 183/367] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:35.673102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1335-96a7-444d-9303-bba45aaf7614 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.725845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7667f-5eae-4849-b0b6-fe7974a9df0c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:35.765633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d8e5d-9e68-429f-bea9-46154e5338e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:35.767032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d8e5d-9e68-429f-bea9-46154e5338e5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.767321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d8e5d-9e68-429f-bea9-46154e5338e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.767597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d8e5d-9e68-429f-bea9-46154e5338e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.768343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d8e5d-9e68-429f-bea9-46154e5338e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:35.769979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d8e5d-9e68-429f-bea9-46154e5338e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:35.769979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d8e5d-9e68-429f-bea9-46154e5338e5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:35.780022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 185/368] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:35.780650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d8e5d-9e68-429f-bea9-46154e5338e5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.795281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1335-96a7-444d-9303-bba45aaf7614 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:35.837800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f385-6eb2-45c4-8989-96514b24d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:35.838092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f385-6eb2-45c4-8989-96514b24d6de None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.838529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f385-6eb2-45c4-8989-96514b24d6de None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.838887 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f385-6eb2-45c4-8989-96514b24d6de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.851318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f385-6eb2-45c4-8989-96514b24d6de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-eb81f385-6eb2-45c4-8989-96514b24d6de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:35.860152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:35.861075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:35.861861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 184/369] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:35.862602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f385-6eb2-45c4-8989-96514b24d6de None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.905800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d8e5d-9e68-429f-bea9-46154e5338e5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:35.945844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdf87e-3e38-4864-8eed-e626f986352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:35.946544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdf87e-3e38-4864-8eed-e626f986352b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:35.946826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdf87e-3e38-4864-8eed-e626f986352b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:35.947097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdf87e-3e38-4864-8eed-e626f986352b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:35.947926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdf87e-3e38-4864-8eed-e626f986352b None admin] RBAC: Adding query filter params (group.id=0da97999d1af4d8db645ef8709636747, role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:35.948233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdf87e-3e38-4864-8eed-e626f986352b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:35.949653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdf87e-3e38-4864-8eed-e626f986352b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:35.958770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 186/370] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/role_assignments?group.id=0da97999d1af4d8db645ef8709636747&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:35.962040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdf87e-3e38-4864-8eed-e626f986352b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:35.993863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f385-6eb2-45c4-8989-96514b24d6de None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:36.043078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ba8e4-5524-4ac4-b4fd-c06cf98674b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:36.043752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ba8e4-5524-4ac4-b4fd-c06cf98674b8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:36.044034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ba8e4-5524-4ac4-b4fd-c06cf98674b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:36.044310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ba8e4-5524-4ac4-b4fd-c06cf98674b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:36.045155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ba8e4-5524-4ac4-b4fd-c06cf98674b8 None admin] RBAC: Adding query filter params (group.id=0da97999d1af4d8db645ef8709636747, role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=40b91b4949b0461a99311b62cd96aa7a) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:36.045467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ba8e4-5524-4ac4-b4fd-c06cf98674b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:36.047001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ba8e4-5524-4ac4-b4fd-c06cf98674b8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:36.054411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 185/371] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/role_assignments?group.id=0da97999d1af4d8db645ef8709636747&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:36.055383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ba8e4-5524-4ac4-b4fd-c06cf98674b8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:36.077633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdf87e-3e38-4864-8eed-e626f986352b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:36.114730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20459f7-0063-4db6-ae01-a01aa6d27d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:36.115386 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20459f7-0063-4db6-ae01-a01aa6d27d77 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:36.115664 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20459f7-0063-4db6-ae01-a01aa6d27d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:36.115934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20459f7-0063-4db6-ae01-a01aa6d27d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:36.166588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ba8e4-5524-4ac4-b4fd-c06cf98674b8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:36.189233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20459f7-0063-4db6-ae01-a01aa6d27d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:36.190749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20459f7-0063-4db6-ae01-a01aa6d27d77 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:36.206546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33c01a-af6f-4c10-8a76-f89def48be01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:36.207230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33c01a-af6f-4c10-8a76-f89def48be01 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:36.207512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33c01a-af6f-4c10-8a76-f89def48be01 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:36.207786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33c01a-af6f-4c10-8a76-f89def48be01 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:36.208544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33c01a-af6f-4c10-8a76-f89def48be01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:36.208958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33c01a-af6f-4c10-8a76-f89def48be01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:36.210461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33c01a-af6f-4c10-8a76-f89def48be01 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:36.220163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 186/372] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:36.225945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33c01a-af6f-4c10-8a76-f89def48be01 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:36.355780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33c01a-af6f-4c10-8a76-f89def48be01 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:36.369770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 187/373] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:36.378563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20459f7-0063-4db6-ae01-a01aa6d27d77 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:36.403049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555233c8-b1fa-4564-86ac-a3abfc8d1ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:36.403717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555233c8-b1fa-4564-86ac-a3abfc8d1ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:36.404278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555233c8-b1fa-4564-86ac-a3abfc8d1ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:36.404563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555233c8-b1fa-4564-86ac-a3abfc8d1ef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:36.526993 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20459f7-0063-4db6-ae01-a01aa6d27d77 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:36.530836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555233c8-b1fa-4564-86ac-a3abfc8d1ef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:36.532868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555233c8-b1fa-4564-86ac-a3abfc8d1ef5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:36.568651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516eeae-0a7a-43bf-9729-4e095dc7e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:36.570346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516eeae-0a7a-43bf-9729-4e095dc7e347 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:36.570834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516eeae-0a7a-43bf-9729-4e095dc7e347 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:36.571321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516eeae-0a7a-43bf-9729-4e095dc7e347 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:36.572732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516eeae-0a7a-43bf-9729-4e095dc7e347 None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:36.574437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516eeae-0a7a-43bf-9729-4e095dc7e347 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:36.576889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 188/374] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:36 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:36.583808 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516eeae-0a7a-43bf-9729-4e095dc7e347 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:36.692375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516eeae-0a7a-43bf-9729-4e095dc7e347 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:36.729912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08e80c-6988-40b4-b265-2f4f7b0e2e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:36.731172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08e80c-6988-40b4-b265-2f4f7b0e2e0f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:36.731648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08e80c-6988-40b4-b265-2f4f7b0e2e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:36.732122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08e80c-6988-40b4-b265-2f4f7b0e2e0f None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:36.733513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08e80c-6988-40b4-b265-2f4f7b0e2e0f None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:36.735893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08e80c-6988-40b4-b265-2f4f7b0e2e0f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:36.737893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 189/375] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:36 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:36.747443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08e80c-6988-40b4-b265-2f4f7b0e2e0f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:36.801732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 187/376] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:36.807465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555233c8-b1fa-4564-86ac-a3abfc8d1ef5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:36.872490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08e80c-6988-40b4-b265-2f4f7b0e2e0f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:36.938173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56024b92-37ba-40a9-bfa7-a6f885046259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:36.938887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56024b92-37ba-40a9-bfa7-a6f885046259 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:36.939176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56024b92-37ba-40a9-bfa7-a6f885046259 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:36.939449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56024b92-37ba-40a9-bfa7-a6f885046259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:36.940287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56024b92-37ba-40a9-bfa7-a6f885046259 None admin] RBAC: Adding query filter params (group.id=0da97999d1af4d8db645ef8709636747, role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:36.940597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56024b92-37ba-40a9-bfa7-a6f885046259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:36.942046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56024b92-37ba-40a9-bfa7-a6f885046259 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:36.959558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 190/377] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:36 2022] GET /identity/v3/role_assignments?group.id=0da97999d1af4d8db645ef8709636747&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:36.986405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555233c8-b1fa-4564-86ac-a3abfc8d1ef5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:37.029158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8360f-7c0b-464a-a9f2-cefbbcd51f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:37.030053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8360f-7c0b-464a-a9f2-cefbbcd51f04 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:37.030336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8360f-7c0b-464a-a9f2-cefbbcd51f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:37.030607 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8360f-7c0b-464a-a9f2-cefbbcd51f04 None admin] PATH_INFO: `/v3/projects/519a641cdee343408fe589d891a54066` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:37.032364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8360f-7c0b-464a-a9f2-cefbbcd51f04 None admin] RBAC: Authorizing `identity:get_project(project_id=519a641cdee343408fe589d891a54066)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:37.033864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8360f-7c0b-464a-a9f2-cefbbcd51f04 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:37.036580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 188/378] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:36 2022] GET /identity/v3/projects/519a641cdee343408fe589d891a54066 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:37.041478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56024b92-37ba-40a9-bfa7-a6f885046259 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:37.163376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56024b92-37ba-40a9-bfa7-a6f885046259 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:37.197584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c2aa4-664c-4d80-8399-4189de7ae76a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:37.197881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c2aa4-664c-4d80-8399-4189de7ae76a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:37.198184 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c2aa4-664c-4d80-8399-4189de7ae76a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:37.202153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 189/379] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:37.208148 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2e514-23e3-4dee-9fae-ca3dfacd4e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:37.209850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2e514-23e3-4dee-9fae-ca3dfacd4e6c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:37.210305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2e514-23e3-4dee-9fae-ca3dfacd4e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:37.210721 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2e514-23e3-4dee-9fae-ca3dfacd4e6c None admin] PATH_INFO: `/v3/groups/4677bd554a9e4b76b3ee575a4367f069` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:37.217661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2e514-23e3-4dee-9fae-ca3dfacd4e6c None admin] RBAC: Authorizing `identity:get_group(group_id=4677bd554a9e4b76b3ee575a4367f069)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:37.219532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2e514-23e3-4dee-9fae-ca3dfacd4e6c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:37.226186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 191/380] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:37 2022] GET /identity/v3/groups/4677bd554a9e4b76b3ee575a4367f069 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:37.228307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c2aa4-664c-4d80-8399-4189de7ae76a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:37.231633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048e4c4-0074-4066-b7c5-499419a8d283 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:37.232080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048e4c4-0074-4066-b7c5-499419a8d283 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:37.232504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048e4c4-0074-4066-b7c5-499419a8d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:37.251651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d048e4c4-0074-4066-b7c5-499419a8d283 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:37.253535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d048e4c4-0074-4066-b7c5-499419a8d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:37.348444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 192/381] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:37.365525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c2aa4-664c-4d80-8399-4189de7ae76a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:37.373212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048e4c4-0074-4066-b7c5-499419a8d283 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:37.462879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34ef21-55de-4b58-b2da-ed8853952d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:37.463476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34ef21-55de-4b58-b2da-ed8853952d6e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:37.463753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34ef21-55de-4b58-b2da-ed8853952d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:37.464020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34ef21-55de-4b58-b2da-ed8853952d6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:37.464852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34ef21-55de-4b58-b2da-ed8853952d6e None admin] RBAC: Adding query filter params (group.id=4677bd554a9e4b76b3ee575a4367f069, role.id=cb77715547a14bae950f68513af00d30, scope.project.id=519a641cdee343408fe589d891a54066) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:37.465160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34ef21-55de-4b58-b2da-ed8853952d6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:37.466635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34ef21-55de-4b58-b2da-ed8853952d6e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:37.477319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 190/382] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:37 2022] GET /identity/v3/role_assignments?group.id=4677bd554a9e4b76b3ee575a4367f069&scope.project.id=519a641cdee343408fe589d891a54066&role.id=cb77715547a14bae950f68513af00d30 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:37.489936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048e4c4-0074-4066-b7c5-499419a8d283 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:37.534429 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7a131-ce17-49cf-9642-9169b1699612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:37.535260 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7a131-ce17-49cf-9642-9169b1699612 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:37.535540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7a131-ce17-49cf-9642-9169b1699612 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:37.535812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7a131-ce17-49cf-9642-9169b1699612 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:37.547761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7a131-ce17-49cf-9642-9169b1699612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-38e7a131-ce17-49cf-9642-9169b1699612 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:37.556208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:37.557159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:37.558464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 193/383] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:37.565868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34ef21-55de-4b58-b2da-ed8853952d6e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:37.699910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34ef21-55de-4b58-b2da-ed8853952d6e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:37.748677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a98c7-ce34-4129-a73a-d7e96c0d443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:37.749290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a98c7-ce34-4129-a73a-d7e96c0d443b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:37.749576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a98c7-ce34-4129-a73a-d7e96c0d443b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:37.749856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a98c7-ce34-4129-a73a-d7e96c0d443b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:37.751227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a98c7-ce34-4129-a73a-d7e96c0d443b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:37.751535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a98c7-ce34-4129-a73a-d7e96c0d443b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:37.752964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a98c7-ce34-4129-a73a-d7e96c0d443b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:37.762643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 191/384] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:37.771133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7a131-ce17-49cf-9642-9169b1699612 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:37.962165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7a131-ce17-49cf-9642-9169b1699612 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:38.021890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e018-c34c-4bdd-bdab-345b75c08cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:38.023201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e018-c34c-4bdd-bdab-345b75c08cfd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:38.023679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e018-c34c-4bdd-bdab-345b75c08cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:38.024144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e018-c34c-4bdd-bdab-345b75c08cfd None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:38.026945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e018-c34c-4bdd-bdab-345b75c08cfd None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:38.028622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e018-c34c-4bdd-bdab-345b75c08cfd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:38.030847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 194/385] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:37 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:38.038822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a98c7-ce34-4129-a73a-d7e96c0d443b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:38.172118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a98c7-ce34-4129-a73a-d7e96c0d443b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:38.215661 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4445c2-ce35-459b-b440-6729b8da244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:38.216546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4445c2-ce35-459b-b440-6729b8da244d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:38.216827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4445c2-ce35-459b-b440-6729b8da244d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:38.217103 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4445c2-ce35-459b-b440-6729b8da244d None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:38.218348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4445c2-ce35-459b-b440-6729b8da244d None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:38.220365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4445c2-ce35-459b-b440-6729b8da244d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:38.222669 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 192/386] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:38 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:38.229088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e018-c34c-4bdd-bdab-345b75c08cfd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:38.403109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e018-c34c-4bdd-bdab-345b75c08cfd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:38.450491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06404498-0e0f-40fd-89d3-c529794e2772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:38.451739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06404498-0e0f-40fd-89d3-c529794e2772 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:38.452244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06404498-0e0f-40fd-89d3-c529794e2772 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:38.452785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06404498-0e0f-40fd-89d3-c529794e2772 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a/groups/0da97999d1af4d8db645ef8709636747/roles/552d2ed1429f43ac91cee158ee03be96` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:38.459271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06404498-0e0f-40fd-89d3-c529794e2772 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b91b4949b0461a99311b62cd96aa7a, group_id=0da97999d1af4d8db645ef8709636747, role_id=552d2ed1429f43ac91cee158ee03be96)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:38.460942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06404498-0e0f-40fd-89d3-c529794e2772 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:38.477873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 195/387] 10.222.0.75 () {58 vars in 1442 bytes} [Tue May 17 15:28:38 2022] PUT /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a/groups/0da97999d1af4d8db645ef8709636747/roles/552d2ed1429f43ac91cee158ee03be96 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:39.034462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a240f-ebf7-479d-8886-dac697ac2149 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.035201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a240f-ebf7-479d-8886-dac697ac2149 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.035695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a240f-ebf7-479d-8886-dac697ac2149 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.037739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 193/388] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:39.043180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03574-e0a4-4ab2-a7c8-bf98e0a4b5a1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.044151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03574-e0a4-4ab2-a7c8-bf98e0a4b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.044635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03574-e0a4-4ab2-a7c8-bf98e0a4b5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.066158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-20e03574-e0a4-4ab2-a7c8-bf98e0a4b5a1 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:39.067679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20e03574-e0a4-4ab2-a7c8-bf98e0a4b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:39.082060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434372f1-efbf-405f-938c-984abdcdd48a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.082060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434372f1-efbf-405f-938c-984abdcdd48a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.082060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434372f1-efbf-405f-938c-984abdcdd48a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.082879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 194/389] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:39.087804 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa7f2c-d863-4ec2-a8d3-9b2da4e3437d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.088013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa7f2c-d863-4ec2-a8d3-9b2da4e3437d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.088285 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa7f2c-d863-4ec2-a8d3-9b2da4e3437d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.113351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-45fa7f2c-d863-4ec2-a8d3-9b2da4e3437d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:39.113351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-45fa7f2c-d863-4ec2-a8d3-9b2da4e3437d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:39.164647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 196/390] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:39.190276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 195/391] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:39.199805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03574-e0a4-4ab2-a7c8-bf98e0a4b5a1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:39.212708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa7f2c-d863-4ec2-a8d3-9b2da4e3437d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:39.376027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03574-e0a4-4ab2-a7c8-bf98e0a4b5a1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:39.382706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa7f2c-d863-4ec2-a8d3-9b2da4e3437d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:39.440318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2073e5e-2307-4241-8a3a-18b42ea6474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:39.441121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2073e5e-2307-4241-8a3a-18b42ea6474d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.441406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2073e5e-2307-4241-8a3a-18b42ea6474d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.441681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2073e5e-2307-4241-8a3a-18b42ea6474d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.444243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21ef8c-0f72-40bd-b654-f072f4b6b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:39.445040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ef8c-0f72-40bd-b654-f072f4b6b90e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.445317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ef8c-0f72-40bd-b654-f072f4b6b90e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.445590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ef8c-0f72-40bd-b654-f072f4b6b90e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.462388 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2073e5e-2307-4241-8a3a-18b42ea6474d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:39.473578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21ef8c-0f72-40bd-b654-f072f4b6b90e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c2073e5e-2307-4241-8a3a-18b42ea6474d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:39.480062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:39.480947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:39.481760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9e21ef8c-0f72-40bd-b654-f072f4b6b90e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:39.483701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:39.485315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:39.486628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:39.488088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 197/392] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:39.490247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 196/393] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:39.491108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2073e5e-2307-4241-8a3a-18b42ea6474d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:39.507842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21ef8c-0f72-40bd-b654-f072f4b6b90e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:39.622811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21ef8c-0f72-40bd-b654-f072f4b6b90e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:39.684009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2073e5e-2307-4241-8a3a-18b42ea6474d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:39.693010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e55130-a567-43b1-a1ed-bec86726865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:39.693682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e55130-a567-43b1-a1ed-bec86726865e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.693959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e55130-a567-43b1-a1ed-bec86726865e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.694256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e55130-a567-43b1-a1ed-bec86726865e None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.695007 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e55130-a567-43b1-a1ed-bec86726865e None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:39.695308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e55130-a567-43b1-a1ed-bec86726865e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:39.696695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e55130-a567-43b1-a1ed-bec86726865e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:39.710675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 197/394] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:39.717419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e55130-a567-43b1-a1ed-bec86726865e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:39.748897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32121-6b61-480b-bcb1-9f96eb43a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:39.749558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32121-6b61-480b-bcb1-9f96eb43a3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.749832 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32121-6b61-480b-bcb1-9f96eb43a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.750639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32121-6b61-480b-bcb1-9f96eb43a3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.751397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32121-6b61-480b-bcb1-9f96eb43a3f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:39.751697 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32121-6b61-480b-bcb1-9f96eb43a3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:39.753060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32121-6b61-480b-bcb1-9f96eb43a3f2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:39.765884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 198/395] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:39.773652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32121-6b61-480b-bcb1-9f96eb43a3f2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:39.882514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e55130-a567-43b1-a1ed-bec86726865e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:39.918751 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065765-1c68-43b9-bb8b-6c0d0e644982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:39.919624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065765-1c68-43b9-bb8b-6c0d0e644982 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.919910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065765-1c68-43b9-bb8b-6c0d0e644982 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.920192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065765-1c68-43b9-bb8b-6c0d0e644982 None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.921380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065765-1c68-43b9-bb8b-6c0d0e644982 None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:39.921831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32121-6b61-480b-bcb1-9f96eb43a3f2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:39.922976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065765-1c68-43b9-bb8b-6c0d0e644982 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:39.930686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 198/396] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:39 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:39.932028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d14b95-db35-465c-bf16-322a42d2a7f2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.932315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d14b95-db35-465c-bf16-322a42d2a7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.932654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d14b95-db35-465c-bf16-322a42d2a7f2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.934940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 199/397] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:39.935808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d14b95-db35-465c-bf16-322a42d2a7f2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:39.970217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcde18-35c3-4ac9-8b9c-70b9655ed4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:39.971494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcde18-35c3-4ac9-8b9c-70b9655ed4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.971779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcde18-35c3-4ac9-8b9c-70b9655ed4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.972055 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcde18-35c3-4ac9-8b9c-70b9655ed4f8 None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:39.973680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcde18-35c3-4ac9-8b9c-70b9655ed4f8 None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:39.975595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcde18-35c3-4ac9-8b9c-70b9655ed4f8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:39.981681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 199/398] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:39 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:39.981681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989bd5f-98c1-4f8d-91dc-fe45353c61b9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:39.981681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989bd5f-98c1-4f8d-91dc-fe45353c61b9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:39.981681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989bd5f-98c1-4f8d-91dc-fe45353c61b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.001212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1989bd5f-98c1-4f8d-91dc-fe45353c61b9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:40.002582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1989bd5f-98c1-4f8d-91dc-fe45353c61b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:40.053330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d14b95-db35-465c-bf16-322a42d2a7f2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:40.089812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bf6d3-b094-4681-9aeb-79cedc3f2870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:40.091663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bf6d3-b094-4681-9aeb-79cedc3f2870 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.092088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bf6d3-b094-4681-9aeb-79cedc3f2870 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.092503 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bf6d3-b094-4681-9aeb-79cedc3f2870 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.093954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bf6d3-b094-4681-9aeb-79cedc3f2870 None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:40.096534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bf6d3-b094-4681-9aeb-79cedc3f2870 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:40.098400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 200/399] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:40.099369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989bd5f-98c1-4f8d-91dc-fe45353c61b9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:40.099550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 200/400] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:39 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:40.111174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bf6d3-b094-4681-9aeb-79cedc3f2870 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:40.215109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989bd5f-98c1-4f8d-91dc-fe45353c61b9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:40.251843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bf6d3-b094-4681-9aeb-79cedc3f2870 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:40.258818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb658398-c450-4235-8029-68498e6842b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:40.260374 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658398-c450-4235-8029-68498e6842b6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.260861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658398-c450-4235-8029-68498e6842b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.261705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658398-c450-4235-8029-68498e6842b6 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.263737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb658398-c450-4235-8029-68498e6842b6 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:40.265574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb658398-c450-4235-8029-68498e6842b6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:40.268321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 201/401] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:40 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:40.269512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb658398-c450-4235-8029-68498e6842b6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:40.291419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0197c0d-18cc-4275-b109-5f21c2e41fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:40.292133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0197c0d-18cc-4275-b109-5f21c2e41fd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.292417 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0197c0d-18cc-4275-b109-5f21c2e41fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.292748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0197c0d-18cc-4275-b109-5f21c2e41fd6 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/groups/0da97999d1af4d8db645ef8709636747/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.294959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0197c0d-18cc-4275-b109-5f21c2e41fd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=29a57b0c3d11422d89bc7c255ab0b339, group_id=0da97999d1af4d8db645ef8709636747, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:40.296465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0197c0d-18cc-4275-b109-5f21c2e41fd6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:40.314573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 201/402] 10.222.0.75 () {58 vars in 1442 bytes} [Tue May 17 15:28:40 2022] PUT /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/groups/0da97999d1af4d8db645ef8709636747/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:40.315624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0197c0d-18cc-4275-b109-5f21c2e41fd6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:40.421510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb658398-c450-4235-8029-68498e6842b6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:40.454723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0197c0d-18cc-4275-b109-5f21c2e41fd6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:40.456690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351400f3-b44a-4175-a8c4-3164ed28917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:40.457512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351400f3-b44a-4175-a8c4-3164ed28917e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.458599 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351400f3-b44a-4175-a8c4-3164ed28917e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.458599 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351400f3-b44a-4175-a8c4-3164ed28917e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.470120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351400f3-b44a-4175-a8c4-3164ed28917e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-351400f3-b44a-4175-a8c4-3164ed28917e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:40.478704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:40.479720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:40.480532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 202/403] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:40.481697 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0503c8-ddfc-4c15-aa58-6efc173b13eb None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.481979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0503c8-ddfc-4c15-aa58-6efc173b13eb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.482290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0503c8-ddfc-4c15-aa58-6efc173b13eb None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.488224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 203/404] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:40.489092 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0503c8-ddfc-4c15-aa58-6efc173b13eb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:40.497759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4048838-0918-431a-a8e2-5b985199049b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:40.499035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048838-0918-431a-a8e2-5b985199049b None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.499547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048838-0918-431a-a8e2-5b985199049b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.500020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048838-0918-431a-a8e2-5b985199049b None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a/groups/0da97999d1af4d8db645ef8709636747/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.502497 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4048838-0918-431a-a8e2-5b985199049b None admin] RBAC: Authorizing `identity:create_grant(project_id=40b91b4949b0461a99311b62cd96aa7a, group_id=0da97999d1af4d8db645ef8709636747, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:40.504199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4048838-0918-431a-a8e2-5b985199049b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:40.521319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 202/405] 10.222.0.75 () {58 vars in 1442 bytes} [Tue May 17 15:28:40 2022] PUT /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a/groups/0da97999d1af4d8db645ef8709636747/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:40.522707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b42703-0e3e-4976-b3ba-f7b4d037ac63 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.523061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b42703-0e3e-4976-b3ba-f7b4d037ac63 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.523347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b42703-0e3e-4976-b3ba-f7b4d037ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.541577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-83b42703-0e3e-4976-b3ba-f7b4d037ac63 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:40.542905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-83b42703-0e3e-4976-b3ba-f7b4d037ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:40.603195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0503c8-ddfc-4c15-aa58-6efc173b13eb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:40.620259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 203/406] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:40.639751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9f7ce-0705-4943-9f92-8136604e313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:40.640426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f7ce-0705-4943-9f92-8136604e313d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.641238 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f7ce-0705-4943-9f92-8136604e313d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.641562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f7ce-0705-4943-9f92-8136604e313d None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.642358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9f7ce-0705-4943-9f92-8136604e313d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:40.642662 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9f7ce-0705-4943-9f92-8136604e313d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:40.644123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9f7ce-0705-4943-9f92-8136604e313d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:40.646990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b42703-0e3e-4976-b3ba-f7b4d037ac63 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:40.653782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 204/407] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:40.660959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9f7ce-0705-4943-9f92-8136604e313d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:40.756741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b42703-0e3e-4976-b3ba-f7b4d037ac63 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:40.798067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9f7ce-0705-4943-9f92-8136604e313d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:40.801360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e55c67-94ea-4643-923a-abfe595bb475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:40.802515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e55c67-94ea-4643-923a-abfe595bb475 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.803003 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e55c67-94ea-4643-923a-abfe595bb475 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.803512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e55c67-94ea-4643-923a-abfe595bb475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.817582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e55c67-94ea-4643-923a-abfe595bb475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f7e55c67-94ea-4643-923a-abfe595bb475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:40.828987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:40.829881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:40.830709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:40.832178 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 204/408] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:28:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:40.838153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e55c67-94ea-4643-923a-abfe595bb475 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:40.841540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27dc81-f6ec-4edd-bacd-574f30a9a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:40.842484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27dc81-f6ec-4edd-bacd-574f30a9a41d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:40.842759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27dc81-f6ec-4edd-bacd-574f30a9a41d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:40.843027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27dc81-f6ec-4edd-bacd-574f30a9a41d None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:40.844888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27dc81-f6ec-4edd-bacd-574f30a9a41d None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:40.846617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27dc81-f6ec-4edd-bacd-574f30a9a41d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:40.852025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 205/409] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:40 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:40.855218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27dc81-f6ec-4edd-bacd-574f30a9a41d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:41.009007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27dc81-f6ec-4edd-bacd-574f30a9a41d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:41.061506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50987473-d333-43ae-adf2-449350d7bae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:41.062396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50987473-d333-43ae-adf2-449350d7bae5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.062718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50987473-d333-43ae-adf2-449350d7bae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.062994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50987473-d333-43ae-adf2-449350d7bae5 None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.065309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e55c67-94ea-4643-923a-abfe595bb475 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:41.067345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50987473-d333-43ae-adf2-449350d7bae5 None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:41.068810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50987473-d333-43ae-adf2-449350d7bae5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:41.071566 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 206/410] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:40 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:41.077186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50987473-d333-43ae-adf2-449350d7bae5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:41.110090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae4bd4-ba58-4d91-b3e7-cf2d50379e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:41.110805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae4bd4-ba58-4d91-b3e7-cf2d50379e70 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.110968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae4bd4-ba58-4d91-b3e7-cf2d50379e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.114036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae4bd4-ba58-4d91-b3e7-cf2d50379e70 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.114036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae4bd4-ba58-4d91-b3e7-cf2d50379e70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:41.114036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae4bd4-ba58-4d91-b3e7-cf2d50379e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:41.114036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae4bd4-ba58-4d91-b3e7-cf2d50379e70 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:41.122122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 205/411] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:41.127336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae4bd4-ba58-4d91-b3e7-cf2d50379e70 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:41.270115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50987473-d333-43ae-adf2-449350d7bae5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:41.310093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae4bd4-ba58-4d91-b3e7-cf2d50379e70 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:41.334435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d363d-9812-4573-95bf-b603f497cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:41.335312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d363d-9812-4573-95bf-b603f497cefc None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.335588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d363d-9812-4573-95bf-b603f497cefc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.335855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d363d-9812-4573-95bf-b603f497cefc None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/groups/0da97999d1af4d8db645ef8709636747/roles/552d2ed1429f43ac91cee158ee03be96` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.342809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d363d-9812-4573-95bf-b603f497cefc None admin] RBAC: Authorizing `identity:create_grant(project_id=29a57b0c3d11422d89bc7c255ab0b339, group_id=0da97999d1af4d8db645ef8709636747, role_id=552d2ed1429f43ac91cee158ee03be96)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:41.344290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d363d-9812-4573-95bf-b603f497cefc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:41.367247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f79eb-3fd7-4519-b9d6-b876ac0cc30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:41.368166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f79eb-3fd7-4519-b9d6-b876ac0cc30d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.368447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f79eb-3fd7-4519-b9d6-b876ac0cc30d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.368725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f79eb-3fd7-4519-b9d6-b876ac0cc30d None admin] PATH_INFO: `/v3/groups/4677bd554a9e4b76b3ee575a4367f069` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.370120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f79eb-3fd7-4519-b9d6-b876ac0cc30d None admin] RBAC: Authorizing `identity:get_group(group_id=4677bd554a9e4b76b3ee575a4367f069)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:41.370846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 207/412] 10.222.0.75 () {58 vars in 1442 bytes} [Tue May 17 15:28:41 2022] PUT /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339/groups/0da97999d1af4d8db645ef8709636747/roles/552d2ed1429f43ac91cee158ee03be96 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:41.371640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f79eb-3fd7-4519-b9d6-b876ac0cc30d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:41.372197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3949-fb5a-4eb4-99c6-8897dcb1f1ed None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.372573 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3949-fb5a-4eb4-99c6-8897dcb1f1ed None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.372846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3949-fb5a-4eb4-99c6-8897dcb1f1ed None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.373636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 206/413] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:41 2022] GET /identity/v3/groups/4677bd554a9e4b76b3ee575a4367f069 => generated 229 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:41.374427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 208/414] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:41.385865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c235b-4ed0-4cfe-b35e-e929dd0e6927 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.386967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e3949-fb5a-4eb4-99c6-8897dcb1f1ed None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:41.390162 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c235b-4ed0-4cfe-b35e-e929dd0e6927 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.390545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c235b-4ed0-4cfe-b35e-e929dd0e6927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.430605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c12c235b-4ed0-4cfe-b35e-e929dd0e6927 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:41.435769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c12c235b-4ed0-4cfe-b35e-e929dd0e6927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:41.558272 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e3949-fb5a-4eb4-99c6-8897dcb1f1ed None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:41.596494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715f55-3a5d-40a6-ab4c-b646d01c946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:41.597602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715f55-3a5d-40a6-ab4c-b646d01c946a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.597869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715f55-3a5d-40a6-ab4c-b646d01c946a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.598207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715f55-3a5d-40a6-ab4c-b646d01c946a None admin] PATH_INFO: `/v3/projects/519a641cdee343408fe589d891a54066` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.599369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b715f55-3a5d-40a6-ab4c-b646d01c946a None admin] RBAC: Authorizing `identity:get_project(project_id=519a641cdee343408fe589d891a54066)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:41.600133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 207/415] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:41.604626 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b715f55-3a5d-40a6-ab4c-b646d01c946a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:41.606537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 209/416] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:41 2022] GET /identity/v3/projects/519a641cdee343408fe589d891a54066 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:41.612780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c235b-4ed0-4cfe-b35e-e929dd0e6927 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:41.629969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715f55-3a5d-40a6-ab4c-b646d01c946a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:41.721994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c235b-4ed0-4cfe-b35e-e929dd0e6927 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:41.736785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715f55-3a5d-40a6-ab4c-b646d01c946a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:41.757410 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514f65f-ad80-45d6-805b-60c1b8158cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:41.758641 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514f65f-ad80-45d6-805b-60c1b8158cf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.759121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514f65f-ad80-45d6-805b-60c1b8158cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.759608 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514f65f-ad80-45d6-805b-60c1b8158cf7 None admin] PATH_INFO: `/v3/projects/519a641cdee343408fe589d891a54066/groups/4677bd554a9e4b76b3ee575a4367f069/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.761781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514f65f-ad80-45d6-805b-60c1b8158cf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=519a641cdee343408fe589d891a54066, group_id=4677bd554a9e4b76b3ee575a4367f069, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:41.763449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514f65f-ad80-45d6-805b-60c1b8158cf7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:41.776966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556250e-5a62-4e46-9997-dea7e31bf40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:41.780203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556250e-5a62-4e46-9997-dea7e31bf40b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.780750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556250e-5a62-4e46-9997-dea7e31bf40b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.781183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556250e-5a62-4e46-9997-dea7e31bf40b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.784972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 208/417] 10.222.0.75 () {58 vars in 1442 bytes} [Tue May 17 15:28:41 2022] PUT /identity/v3/projects/519a641cdee343408fe589d891a54066/groups/4677bd554a9e4b76b3ee575a4367f069/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:28:41.795159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556250e-5a62-4e46-9997-dea7e31bf40b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d556250e-5a62-4e46-9997-dea7e31bf40b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:41.804610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:41.805555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:41.806417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:41.813779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 210/418] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:41.815475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514f65f-ad80-45d6-805b-60c1b8158cf7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:41.926114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514f65f-ad80-45d6-805b-60c1b8158cf7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:41.974899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6b89d-61d5-4565-a891-306bc31fa36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:41.975904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6b89d-61d5-4565-a891-306bc31fa36e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:41.976330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6b89d-61d5-4565-a891-306bc31fa36e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:41.976794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6b89d-61d5-4565-a891-306bc31fa36e None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:41.977689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6b89d-61d5-4565-a891-306bc31fa36e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:41.978161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6b89d-61d5-4565-a891-306bc31fa36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:41.979825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6b89d-61d5-4565-a891-306bc31fa36e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:41.994170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 209/419] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:42.000158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556250e-5a62-4e46-9997-dea7e31bf40b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:42.105932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556250e-5a62-4e46-9997-dea7e31bf40b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:42.143459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1f8cf-b74c-4052-a29b-6ae574287a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:42.144417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1f8cf-b74c-4052-a29b-6ae574287a4e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:42.144851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1f8cf-b74c-4052-a29b-6ae574287a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:42.145266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1f8cf-b74c-4052-a29b-6ae574287a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:42.213718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1f8cf-b74c-4052-a29b-6ae574287a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:42.215193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1f8cf-b74c-4052-a29b-6ae574287a4e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:42.336999 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 211/420] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:42.342560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6b89d-61d5-4565-a891-306bc31fa36e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:42.473864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6b89d-61d5-4565-a891-306bc31fa36e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:42.523266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722aaa9-2254-4e16-b9dc-f5d0ab131203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:42.524138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722aaa9-2254-4e16-b9dc-f5d0ab131203 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:42.524415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722aaa9-2254-4e16-b9dc-f5d0ab131203 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:42.524687 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722aaa9-2254-4e16-b9dc-f5d0ab131203 None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:42.525871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722aaa9-2254-4e16-b9dc-f5d0ab131203 None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:42.527359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722aaa9-2254-4e16-b9dc-f5d0ab131203 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:42.529208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 210/421] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:42 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:42.535698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1f8cf-b74c-4052-a29b-6ae574287a4e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:42.691387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1f8cf-b74c-4052-a29b-6ae574287a4e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:42.729488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79796c5-d299-48dd-8e17-5971eac19962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:42.730250 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79796c5-d299-48dd-8e17-5971eac19962 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:42.730529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79796c5-d299-48dd-8e17-5971eac19962 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:42.730800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79796c5-d299-48dd-8e17-5971eac19962 None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:42.731965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79796c5-d299-48dd-8e17-5971eac19962 None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:42.733398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79796c5-d299-48dd-8e17-5971eac19962 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:42.735058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 212/422] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:42 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:42.740883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722aaa9-2254-4e16-b9dc-f5d0ab131203 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:42.861914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722aaa9-2254-4e16-b9dc-f5d0ab131203 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:42.905093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8af1b8-4c2b-435e-8b74-44c85cc53587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:42.905743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8af1b8-4c2b-435e-8b74-44c85cc53587 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:42.906037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8af1b8-4c2b-435e-8b74-44c85cc53587 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:42.906343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8af1b8-4c2b-435e-8b74-44c85cc53587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:42.907167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8af1b8-4c2b-435e-8b74-44c85cc53587 None admin] RBAC: Adding query filter params (group.id=0da97999d1af4d8db645ef8709636747, role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=40b91b4949b0461a99311b62cd96aa7a) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:42.907472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8af1b8-4c2b-435e-8b74-44c85cc53587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:42.908892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8af1b8-4c2b-435e-8b74-44c85cc53587 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:42.917078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 211/423] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:42 2022] GET /identity/v3/role_assignments?group.id=0da97999d1af4d8db645ef8709636747&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:43.152355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc4855-5efd-4e29-aa0a-ae9da8976828 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.152646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc4855-5efd-4e29-aa0a-ae9da8976828 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.152927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc4855-5efd-4e29-aa0a-ae9da8976828 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.154707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 213/424] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:43.159551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370038-83df-465b-89cf-6946ccd45bb6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.159838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370038-83df-465b-89cf-6946ccd45bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.160117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370038-83df-465b-89cf-6946ccd45bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.179456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-84370038-83df-465b-89cf-6946ccd45bb6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:43.180621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-84370038-83df-465b-89cf-6946ccd45bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:43.224859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ffa76-5e56-42fc-adcd-3ced785f1b52 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.225149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ffa76-5e56-42fc-adcd-3ced785f1b52 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.225428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ffa76-5e56-42fc-adcd-3ced785f1b52 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.227057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 214/425] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:43.234030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03ce8-aec1-4cc0-ba9c-dae0e467de89 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.234030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03ce8-aec1-4cc0-ba9c-dae0e467de89 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.234030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03ce8-aec1-4cc0-ba9c-dae0e467de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.260872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9ed03ce8-aec1-4cc0-ba9c-dae0e467de89 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:43.263141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 212/426] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:43.263249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9ed03ce8-aec1-4cc0-ba9c-dae0e467de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:43.289500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84370038-83df-465b-89cf-6946ccd45bb6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:43.350333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 215/427] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:43.377108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03ce8-aec1-4cc0-ba9c-dae0e467de89 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:43.409748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84370038-83df-465b-89cf-6946ccd45bb6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:43.444034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d2e77-8cde-4a26-95ee-8ba85d005f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:43.445170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d2e77-8cde-4a26-95ee-8ba85d005f75 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.445621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d2e77-8cde-4a26-95ee-8ba85d005f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.446091 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d2e77-8cde-4a26-95ee-8ba85d005f75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.456621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d2e77-8cde-4a26-95ee-8ba85d005f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-b64d2e77-8cde-4a26-95ee-8ba85d005f75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:43.464588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:43.465466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:43.466347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:43.474220 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 213/428] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:43.475253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d2e77-8cde-4a26-95ee-8ba85d005f75 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:43.482466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03ce8-aec1-4cc0-ba9c-dae0e467de89 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:43.516919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24aaeb-3e83-4f17-9ef9-5aa6c373d9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:43.517864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24aaeb-3e83-4f17-9ef9-5aa6c373d9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.518310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24aaeb-3e83-4f17-9ef9-5aa6c373d9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.518641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24aaeb-3e83-4f17-9ef9-5aa6c373d9e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.529358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24aaeb-3e83-4f17-9ef9-5aa6c373d9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ae24aaeb-3e83-4f17-9ef9-5aa6c373d9e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:43.537533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:43.538660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 15:28:43.539580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:43.540981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 216/429] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:43.546223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24aaeb-3e83-4f17-9ef9-5aa6c373d9e7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:43.581399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d2e77-8cde-4a26-95ee-8ba85d005f75 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:43.616647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca5ea6-adf6-4b21-a8da-d58877fd87c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:43.617624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca5ea6-adf6-4b21-a8da-d58877fd87c1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.618106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca5ea6-adf6-4b21-a8da-d58877fd87c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.618548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca5ea6-adf6-4b21-a8da-d58877fd87c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.619605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca5ea6-adf6-4b21-a8da-d58877fd87c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:43.620078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca5ea6-adf6-4b21-a8da-d58877fd87c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:43.621654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca5ea6-adf6-4b21-a8da-d58877fd87c1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:43.634853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 214/430] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:43.636048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca5ea6-adf6-4b21-a8da-d58877fd87c1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:43.647029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24aaeb-3e83-4f17-9ef9-5aa6c373d9e7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:43.680911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7b49-65cb-4ead-bda5-f0ed6058602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:43.681493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7b49-65cb-4ead-bda5-f0ed6058602f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.681775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7b49-65cb-4ead-bda5-f0ed6058602f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.682095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7b49-65cb-4ead-bda5-f0ed6058602f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.682848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7b49-65cb-4ead-bda5-f0ed6058602f None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:43.683156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7b49-65cb-4ead-bda5-f0ed6058602f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:43.684560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7b49-65cb-4ead-bda5-f0ed6058602f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:43.693009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 217/431] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:28:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:43.698105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7b49-65cb-4ead-bda5-f0ed6058602f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:43.737456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca5ea6-adf6-4b21-a8da-d58877fd87c1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:43.771107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b51bb-7c49-4fe5-ba7c-cf6022d7d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:43.772099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b51bb-7c49-4fe5-ba7c-cf6022d7d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.772596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b51bb-7c49-4fe5-ba7c-cf6022d7d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.773062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b51bb-7c49-4fe5-ba7c-cf6022d7d8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.801404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7b49-65cb-4ead-bda5-f0ed6058602f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:43.836045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683e25-ef0d-4c68-bb83-78988bbf67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:43.836590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683e25-ef0d-4c68-bb83-78988bbf67d5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:43.836877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683e25-ef0d-4c68-bb83-78988bbf67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:43.837156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683e25-ef0d-4c68-bb83-78988bbf67d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:43.840250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b51bb-7c49-4fe5-ba7c-cf6022d7d8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:43.841937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b51bb-7c49-4fe5-ba7c-cf6022d7d8e8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:43.907263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683e25-ef0d-4c68-bb83-78988bbf67d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:43.908735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683e25-ef0d-4c68-bb83-78988bbf67d5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:43.940637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 215/432] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:43.947420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b51bb-7c49-4fe5-ba7c-cf6022d7d8e8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.020981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 218/433] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 15:28:44.025751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683e25-ef0d-4c68-bb83-78988bbf67d5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.053950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b51bb-7c49-4fe5-ba7c-cf6022d7d8e8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.089345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a9922-9643-4d76-9495-fd14e6cc741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.090590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a9922-9643-4d76-9495-fd14e6cc741e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.091085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a9922-9643-4d76-9495-fd14e6cc741e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.091544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a9922-9643-4d76-9495-fd14e6cc741e None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.092939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a9922-9643-4d76-9495-fd14e6cc741e None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:44.094651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a9922-9643-4d76-9495-fd14e6cc741e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:44.101371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 216/434] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:43 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:44.102460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a9922-9643-4d76-9495-fd14e6cc741e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.126728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683e25-ef0d-4c68-bb83-78988bbf67d5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.161189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e139b-8f7b-45a8-b24e-2c9beff8d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.162148 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e139b-8f7b-45a8-b24e-2c9beff8d57d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.162363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e139b-8f7b-45a8-b24e-2c9beff8d57d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.162635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e139b-8f7b-45a8-b24e-2c9beff8d57d None admin] PATH_INFO: `/v3/projects/40b91b4949b0461a99311b62cd96aa7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.163821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e139b-8f7b-45a8-b24e-2c9beff8d57d None admin] RBAC: Authorizing `identity:get_project(project_id=40b91b4949b0461a99311b62cd96aa7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:44.165263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e139b-8f7b-45a8-b24e-2c9beff8d57d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:44.171455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 219/435] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/projects/40b91b4949b0461a99311b62cd96aa7a => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:44.172746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e139b-8f7b-45a8-b24e-2c9beff8d57d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.205675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a9922-9643-4d76-9495-fd14e6cc741e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.244652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87b9fe-bfc1-4c5b-9936-d51bbc2d21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.245604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87b9fe-bfc1-4c5b-9936-d51bbc2d21ac None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.245882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87b9fe-bfc1-4c5b-9936-d51bbc2d21ac None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.246183 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87b9fe-bfc1-4c5b-9936-d51bbc2d21ac None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.247362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87b9fe-bfc1-4c5b-9936-d51bbc2d21ac None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:44.248799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87b9fe-bfc1-4c5b-9936-d51bbc2d21ac None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:44.254609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 217/436] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:44.254609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a686aa3-9c26-4b14-b5dd-92e56c229c30 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.254609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a686aa3-9c26-4b14-b5dd-92e56c229c30 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.254609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a686aa3-9c26-4b14-b5dd-92e56c229c30 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.254609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 218/437] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:44.257477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a686aa3-9c26-4b14-b5dd-92e56c229c30 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.278920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e139b-8f7b-45a8-b24e-2c9beff8d57d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.313876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72817965-7a90-41c3-8210-a40bdb9e17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.315172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72817965-7a90-41c3-8210-a40bdb9e17dd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.315599 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72817965-7a90-41c3-8210-a40bdb9e17dd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.315872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72817965-7a90-41c3-8210-a40bdb9e17dd None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.317059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72817965-7a90-41c3-8210-a40bdb9e17dd None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:44.318620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72817965-7a90-41c3-8210-a40bdb9e17dd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:44.325003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 220/438] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:44.325003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a5730-def4-4cb3-9949-95b05b3dd72d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.325003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a5730-def4-4cb3-9949-95b05b3dd72d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.325003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a5730-def4-4cb3-9949-95b05b3dd72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.338406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bd2a5730-def4-4cb3-9949-95b05b3dd72d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:44.339639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bd2a5730-def4-4cb3-9949-95b05b3dd72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:44.371597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a686aa3-9c26-4b14-b5dd-92e56c229c30 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.407815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05645c3-40a6-470c-a706-989c3989af3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.408478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05645c3-40a6-470c-a706-989c3989af3e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.408749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05645c3-40a6-470c-a706-989c3989af3e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.409022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05645c3-40a6-470c-a706-989c3989af3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.409849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05645c3-40a6-470c-a706-989c3989af3e None admin] RBAC: Adding query filter params (group.id=0da97999d1af4d8db645ef8709636747, role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:44.410407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05645c3-40a6-470c-a706-989c3989af3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:44.411619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05645c3-40a6-470c-a706-989c3989af3e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:44.414962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 221/439] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:44.415705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a5730-def4-4cb3-9949-95b05b3dd72d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.431978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 219/440] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/role_assignments?group.id=0da97999d1af4d8db645ef8709636747&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:44.443731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05645c3-40a6-470c-a706-989c3989af3e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.542493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a5730-def4-4cb3-9949-95b05b3dd72d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.572194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05645c3-40a6-470c-a706-989c3989af3e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.578376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532b992-9622-46b5-914b-ab3970413360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.579037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532b992-9622-46b5-914b-ab3970413360 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.579316 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532b992-9622-46b5-914b-ab3970413360 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.579583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532b992-9622-46b5-914b-ab3970413360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.580420 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532b992-9622-46b5-914b-ab3970413360 None admin] RBAC: Adding query filter params (group.id=0da97999d1af4d8db645ef8709636747, role.id=77cf47a512e2416eb2126eb72db4f14b, scope.project.id=40b91b4949b0461a99311b62cd96aa7a) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:44.580719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532b992-9622-46b5-914b-ab3970413360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:44.582186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532b992-9622-46b5-914b-ab3970413360 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:44.588311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 222/441] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/role_assignments?group.id=0da97999d1af4d8db645ef8709636747&scope.project.id=40b91b4949b0461a99311b62cd96aa7a&role.id=77cf47a512e2416eb2126eb72db4f14b => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:44.589628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb74f73-8aa5-4b90-ba37-a0c8c5f42784 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.589908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb74f73-8aa5-4b90-ba37-a0c8c5f42784 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.590208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb74f73-8aa5-4b90-ba37-a0c8c5f42784 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.591485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 223/442] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:44.600324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b883b-afc4-4894-94e2-0b93cee18000 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.600760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b883b-afc4-4894-94e2-0b93cee18000 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.601141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b883b-afc4-4894-94e2-0b93cee18000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.620469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a798698-605a-46ce-b86b-f3cc8705f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.621611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a798698-605a-46ce-b86b-f3cc8705f686 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.622136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a798698-605a-46ce-b86b-f3cc8705f686 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.622574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a798698-605a-46ce-b86b-f3cc8705f686 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.624006 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fc0b883b-afc4-4894-94e2-0b93cee18000 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:44.626447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fc0b883b-afc4-4894-94e2-0b93cee18000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:44.636020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a798698-605a-46ce-b86b-f3cc8705f686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1a798698-605a-46ce-b86b-f3cc8705f686 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:44.645308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:44.646625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:44.647416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 220/443] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:44.653433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a798698-605a-46ce-b86b-f3cc8705f686 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.734049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 224/444] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:44.750972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b883b-afc4-4894-94e2-0b93cee18000 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.770647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a798698-605a-46ce-b86b-f3cc8705f686 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.807404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3a3cb-d7c9-4906-b9f7-2d14a079f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.808164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3a3cb-d7c9-4906-b9f7-2d14a079f520 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.808762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3a3cb-d7c9-4906-b9f7-2d14a079f520 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.809184 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3a3cb-d7c9-4906-b9f7-2d14a079f520 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.810136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3a3cb-d7c9-4906-b9f7-2d14a079f520 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:44.810602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3a3cb-d7c9-4906-b9f7-2d14a079f520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:44.812646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3a3cb-d7c9-4906-b9f7-2d14a079f520 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:44.820724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 221/445] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:44.826358 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3a3cb-d7c9-4906-b9f7-2d14a079f520 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.857191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b883b-afc4-4894-94e2-0b93cee18000 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.894093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3623075-3fb2-4dd2-9939-8529f87307c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.894810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3623075-3fb2-4dd2-9939-8529f87307c0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.895137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3623075-3fb2-4dd2-9939-8529f87307c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.895352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3623075-3fb2-4dd2-9939-8529f87307c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:44.907497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3623075-3fb2-4dd2-9939-8529f87307c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f3623075-3fb2-4dd2-9939-8529f87307c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:44.915125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:44.916079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:44.916890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 225/446] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:44.922667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3623075-3fb2-4dd2-9939-8529f87307c0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:44.938061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3a3cb-d7c9-4906-b9f7-2d14a079f520 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:44.974508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b3318-55db-41c4-a10c-a6af9784b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:44.975713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b3318-55db-41c4-a10c-a6af9784b75f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:44.976191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b3318-55db-41c4-a10c-a6af9784b75f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:44.976544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b3318-55db-41c4-a10c-a6af9784b75f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:45.030496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3623075-3fb2-4dd2-9939-8529f87307c0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:45.058909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b3318-55db-41c4-a10c-a6af9784b75f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:45.060333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b3318-55db-41c4-a10c-a6af9784b75f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:45.071047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73a802-cbce-4004-b5b7-34f752741b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:45.071711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73a802-cbce-4004-b5b7-34f752741b1d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:45.071988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73a802-cbce-4004-b5b7-34f752741b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:45.074890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73a802-cbce-4004-b5b7-34f752741b1d None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:45.074890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73a802-cbce-4004-b5b7-34f752741b1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:45.074890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73a802-cbce-4004-b5b7-34f752741b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:45.074890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73a802-cbce-4004-b5b7-34f752741b1d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:45.083716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 226/447] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:45.088958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73a802-cbce-4004-b5b7-34f752741b1d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:45.176166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 222/448] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 15:28:45.181913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b3318-55db-41c4-a10c-a6af9784b75f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:45.198840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73a802-cbce-4004-b5b7-34f752741b1d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:45.233704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9aa24-ffdd-49b8-97c7-f8123b8bba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:45.235132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9aa24-ffdd-49b8-97c7-f8123b8bba95 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:45.235350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9aa24-ffdd-49b8-97c7-f8123b8bba95 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:45.235620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9aa24-ffdd-49b8-97c7-f8123b8bba95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:45.293899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b3318-55db-41c4-a10c-a6af9784b75f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:45.308727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9aa24-ffdd-49b8-97c7-f8123b8bba95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:45.310350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9aa24-ffdd-49b8-97c7-f8123b8bba95 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:45.327222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d267c99-ff7c-461e-95bc-3ae3cb54975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:45.328151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d267c99-ff7c-461e-95bc-3ae3cb54975b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:45.328606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d267c99-ff7c-461e-95bc-3ae3cb54975b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:45.329081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d267c99-ff7c-461e-95bc-3ae3cb54975b None admin] PATH_INFO: `/v3/projects/29a57b0c3d11422d89bc7c255ab0b339` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:45.331128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d267c99-ff7c-461e-95bc-3ae3cb54975b None admin] RBAC: Authorizing `identity:get_project(project_id=29a57b0c3d11422d89bc7c255ab0b339)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:45.333721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d267c99-ff7c-461e-95bc-3ae3cb54975b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:45.335462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 223/449] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:45 2022] GET /identity/v3/projects/29a57b0c3d11422d89bc7c255ab0b339 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:45.340794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d267c99-ff7c-461e-95bc-3ae3cb54975b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:45.406880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 227/450] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 15:28:45.412320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9aa24-ffdd-49b8-97c7-f8123b8bba95 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:45.433592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d267c99-ff7c-461e-95bc-3ae3cb54975b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:45.467017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b18321-ad0c-4fab-8487-0ecf13ac0f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:45.467862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b18321-ad0c-4fab-8487-0ecf13ac0f20 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:45.468139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b18321-ad0c-4fab-8487-0ecf13ac0f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:45.468406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b18321-ad0c-4fab-8487-0ecf13ac0f20 None admin] PATH_INFO: `/v3/groups/0da97999d1af4d8db645ef8709636747` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:45.470223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b18321-ad0c-4fab-8487-0ecf13ac0f20 None admin] RBAC: Authorizing `identity:get_group(group_id=0da97999d1af4d8db645ef8709636747)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:45.471932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b18321-ad0c-4fab-8487-0ecf13ac0f20 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:45.473516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 224/451] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:45 2022] GET /identity/v3/groups/0da97999d1af4d8db645ef8709636747 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:45.479101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b18321-ad0c-4fab-8487-0ecf13ac0f20 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:45.503443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9aa24-ffdd-49b8-97c7-f8123b8bba95 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:45.534915 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38409a8c-36a6-4621-95f2-03a5aa98f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:45.535746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409a8c-36a6-4621-95f2-03a5aa98f4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:45.536028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409a8c-36a6-4621-95f2-03a5aa98f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:45.536300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409a8c-36a6-4621-95f2-03a5aa98f4b1 None admin] PATH_INFO: `/v3/projects/519a641cdee343408fe589d891a54066` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:45.537469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38409a8c-36a6-4621-95f2-03a5aa98f4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=519a641cdee343408fe589d891a54066)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:45.538924 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38409a8c-36a6-4621-95f2-03a5aa98f4b1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:45.540608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 228/452] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:28:45 2022] GET /identity/v3/projects/519a641cdee343408fe589d891a54066 => generated 344 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:45.547642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38409a8c-36a6-4621-95f2-03a5aa98f4b1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:45.569827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b18321-ad0c-4fab-8487-0ecf13ac0f20 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:45.601712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485930-f40e-4025-8862-a854a6dc4929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:45.602399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485930-f40e-4025-8862-a854a6dc4929 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:45.602682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485930-f40e-4025-8862-a854a6dc4929 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:45.602955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485930-f40e-4025-8862-a854a6dc4929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:45.603813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485930-f40e-4025-8862-a854a6dc4929 None admin] RBAC: Adding query filter params (group.id=0da97999d1af4d8db645ef8709636747, role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=29a57b0c3d11422d89bc7c255ab0b339) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:45.604122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485930-f40e-4025-8862-a854a6dc4929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:45.605556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485930-f40e-4025-8862-a854a6dc4929 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:45.611763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 225/453] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:45 2022] GET /identity/v3/role_assignments?group.id=0da97999d1af4d8db645ef8709636747&scope.project.id=29a57b0c3d11422d89bc7c255ab0b339&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:45.643996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38409a8c-36a6-4621-95f2-03a5aa98f4b1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:45.679463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52fb54-be3c-4e7e-878d-9d82fc109e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:45.680326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52fb54-be3c-4e7e-878d-9d82fc109e0b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:45.680601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52fb54-be3c-4e7e-878d-9d82fc109e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:45.680870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52fb54-be3c-4e7e-878d-9d82fc109e0b None admin] PATH_INFO: `/v3/groups/4677bd554a9e4b76b3ee575a4367f069` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:45.682393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52fb54-be3c-4e7e-878d-9d82fc109e0b None admin] RBAC: Authorizing `identity:get_group(group_id=4677bd554a9e4b76b3ee575a4367f069)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:45.683890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52fb54-be3c-4e7e-878d-9d82fc109e0b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:45.685603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 229/454] 10.222.0.75 () {56 vars in 1180 bytes} [Tue May 17 15:28:45 2022] GET /identity/v3/groups/4677bd554a9e4b76b3ee575a4367f069 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:45.692660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485930-f40e-4025-8862-a854a6dc4929 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:45.791999 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485930-f40e-4025-8862-a854a6dc4929 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:45.825105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538de7f2-1135-4a4c-91e2-fee7ff4e77df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:45.825694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538de7f2-1135-4a4c-91e2-fee7ff4e77df None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:45.825976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538de7f2-1135-4a4c-91e2-fee7ff4e77df None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:45.826283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538de7f2-1135-4a4c-91e2-fee7ff4e77df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:45.827139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538de7f2-1135-4a4c-91e2-fee7ff4e77df None admin] RBAC: Adding query filter params (group.id=4677bd554a9e4b76b3ee575a4367f069, role.id=cb77715547a14bae950f68513af00d30, scope.project.id=519a641cdee343408fe589d891a54066) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:45.827451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538de7f2-1135-4a4c-91e2-fee7ff4e77df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:45.828915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538de7f2-1135-4a4c-91e2-fee7ff4e77df None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:45.835281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 226/455] 10.222.0.75 () {56 vars in 1376 bytes} [Tue May 17 15:28:45 2022] GET /identity/v3/role_assignments?group.id=4677bd554a9e4b76b3ee575a4367f069&scope.project.id=519a641cdee343408fe589d891a54066&role.id=cb77715547a14bae950f68513af00d30 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:48.520480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b37ca-e883-40c4-8827-01d1aaf2d3ae None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:48.520994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b37ca-e883-40c4-8827-01d1aaf2d3ae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:48.520994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b37ca-e883-40c4-8827-01d1aaf2d3ae None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:48.522672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 230/456] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:48.527994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3609990-8d36-4f17-887c-2e500296df2f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:48.528805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3609990-8d36-4f17-887c-2e500296df2f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:48.529308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3609990-8d36-4f17-887c-2e500296df2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:48.558978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e3609990-8d36-4f17-887c-2e500296df2f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:48.560177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e3609990-8d36-4f17-887c-2e500296df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:48.626505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261adcb2-0cdb-4268-8d93-f98bda722b9b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:48.627143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261adcb2-0cdb-4268-8d93-f98bda722b9b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:48.627519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261adcb2-0cdb-4268-8d93-f98bda722b9b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:48.630242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 231/457] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:48.639387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4812dc6-8a23-4011-852c-ae7e0ebe9d48 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:48.639673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4812dc6-8a23-4011-852c-ae7e0ebe9d48 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:48.639947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4812dc6-8a23-4011-852c-ae7e0ebe9d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:48.645479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 227/458] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:48.667806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f4812dc6-8a23-4011-852c-ae7e0ebe9d48 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:48.668975 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f4812dc6-8a23-4011-852c-ae7e0ebe9d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:48.695394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3609990-8d36-4f17-887c-2e500296df2f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:48.792803 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 232/459] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:48.817432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4812dc6-8a23-4011-852c-ae7e0ebe9d48 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:48.869378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3609990-8d36-4f17-887c-2e500296df2f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:48.938206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5e86e-e1c2-4bb7-8c05-0a277dfc8e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:48.939827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5e86e-e1c2-4bb7-8c05-0a277dfc8e75 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:48.940498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5e86e-e1c2-4bb7-8c05-0a277dfc8e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:48.941182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5e86e-e1c2-4bb7-8c05-0a277dfc8e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:48.962893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4812dc6-8a23-4011-852c-ae7e0ebe9d48 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:48.963297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5e86e-e1c2-4bb7-8c05-0a277dfc8e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:48.964642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5e86e-e1c2-4bb7-8c05-0a277dfc8e75 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-24c5e86e-e1c2-4bb7-8c05-0a277dfc8e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:48.986567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:48.987505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:48.988363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:48.988363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:48.988363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:48.988363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:48.988363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 228/460] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:48.989394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a67c-2bd8-46a2-8df0-e468e8b32f32 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:48.993372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a67c-2bd8-46a2-8df0-e468e8b32f32 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:48.993372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a67c-2bd8-46a2-8df0-e468e8b32f32 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:48.993372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 229/461] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:48.996374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187a67c-2bd8-46a2-8df0-e468e8b32f32 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:49.005627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aced09-849a-4655-bd16-f0075c7016ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:49.006669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aced09-849a-4655-bd16-f0075c7016ff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.007523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aced09-849a-4655-bd16-f0075c7016ff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.007941 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aced09-849a-4655-bd16-f0075c7016ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.020932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aced09-849a-4655-bd16-f0075c7016ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:49.023290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aced09-849a-4655-bd16-f0075c7016ff None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-97aced09-849a-4655-bd16-f0075c7016ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:49.045169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:49.046252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:49.047335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:49.047335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:49.047335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:49.047335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:49.047592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 233/462] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:49.050085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e81ef9-165a-41fe-bd33-71352894c190 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.050085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e81ef9-165a-41fe-bd33-71352894c190 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.050085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e81ef9-165a-41fe-bd33-71352894c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.068905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-20e81ef9-165a-41fe-bd33-71352894c190 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:49.070285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20e81ef9-165a-41fe-bd33-71352894c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:49.115853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187a67c-2bd8-46a2-8df0-e468e8b32f32 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:49.151465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 234/463] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:49.152378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e81ef9-165a-41fe-bd33-71352894c190 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:49.160658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0736935-957a-4d6d-ada9-156597cf730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:49.161584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0736935-957a-4d6d-ada9-156597cf730d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.162111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0736935-957a-4d6d-ada9-156597cf730d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.162701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0736935-957a-4d6d-ada9-156597cf730d None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.163627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0736935-957a-4d6d-ada9-156597cf730d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:49.164134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0736935-957a-4d6d-ada9-156597cf730d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:49.165731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0736935-957a-4d6d-ada9-156597cf730d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:49.183508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 230/464] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:49.189952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0736935-957a-4d6d-ada9-156597cf730d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:49.257677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e81ef9-165a-41fe-bd33-71352894c190 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:49.292062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689acb3-ac5a-41cd-b9ec-382f08c65470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:49.292739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689acb3-ac5a-41cd-b9ec-382f08c65470 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.293015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689acb3-ac5a-41cd-b9ec-382f08c65470 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.293287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689acb3-ac5a-41cd-b9ec-382f08c65470 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.294485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689acb3-ac5a-41cd-b9ec-382f08c65470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:49.294485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689acb3-ac5a-41cd-b9ec-382f08c65470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:49.296044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689acb3-ac5a-41cd-b9ec-382f08c65470 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:49.301112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0736935-957a-4d6d-ada9-156597cf730d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:49.308772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 235/465] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:49.309831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689acb3-ac5a-41cd-b9ec-382f08c65470 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:49.343731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b739680-8ecc-484a-aac9-ff53242b3b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:49.344975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b739680-8ecc-484a-aac9-ff53242b3b93 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.345499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b739680-8ecc-484a-aac9-ff53242b3b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.346013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b739680-8ecc-484a-aac9-ff53242b3b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.357245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b739680-8ecc-484a-aac9-ff53242b3b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:49.359050 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b739680-8ecc-484a-aac9-ff53242b3b93 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7b739680-8ecc-484a-aac9-ff53242b3b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:49.377965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:49.378889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:49.379746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:49.379746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:49.379746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:49.379746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:49.386635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 231/466] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:49.387689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b739680-8ecc-484a-aac9-ff53242b3b93 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:49.412129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689acb3-ac5a-41cd-b9ec-382f08c65470 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:49.445289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c9d64-2c47-4fd9-bb1b-639eca7a6a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:49.445953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c9d64-2c47-4fd9-bb1b-639eca7a6a3e None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.446282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c9d64-2c47-4fd9-bb1b-639eca7a6a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.446799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c9d64-2c47-4fd9-bb1b-639eca7a6a3e None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.447234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c9d64-2c47-4fd9-bb1b-639eca7a6a3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:49.448643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c9d64-2c47-4fd9-bb1b-639eca7a6a3e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:49.478024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 236/467] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:49 2022] POST /identity/v3/users => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:49.478024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c9d64-2c47-4fd9-bb1b-639eca7a6a3e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:49.517234 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b739680-8ecc-484a-aac9-ff53242b3b93 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:49.568632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3c0e8-cfe2-443b-b57c-f242d674f759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:49.569253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c0e8-cfe2-443b-b57c-f242d674f759 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.569527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c0e8-cfe2-443b-b57c-f242d674f759 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.569803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c0e8-cfe2-443b-b57c-f242d674f759 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.570546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3c0e8-cfe2-443b-b57c-f242d674f759 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:49.572028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3c0e8-cfe2-443b-b57c-f242d674f759 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:49.596316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 232/468] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:49 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:49.597992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7338618-51ff-4394-8508-e0d01bb877a6 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.598385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7338618-51ff-4394-8508-e0d01bb877a6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.598721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7338618-51ff-4394-8508-e0d01bb877a6 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.600670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 233/469] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:49.607214 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad3a0e-e57f-42b8-9168-57d3a092f74b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.607528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad3a0e-e57f-42b8-9168-57d3a092f74b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.607764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad3a0e-e57f-42b8-9168-57d3a092f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.611006 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c9d64-2c47-4fd9-bb1b-639eca7a6a3e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:49.626774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-64ad3a0e-e57f-42b8-9168-57d3a092f74b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:49.628028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-64ad3a0e-e57f-42b8-9168-57d3a092f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:49.657546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa9626-8623-4c9c-87d7-7bb367905902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:49.658514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa9626-8623-4c9c-87d7-7bb367905902 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.658795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa9626-8623-4c9c-87d7-7bb367905902 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.659275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa9626-8623-4c9c-87d7-7bb367905902 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.660369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa9626-8623-4c9c-87d7-7bb367905902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:49.660945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa9626-8623-4c9c-87d7-7bb367905902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:49.662383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa9626-8623-4c9c-87d7-7bb367905902 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:49.679454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 237/470] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:49.685331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa9626-8623-4c9c-87d7-7bb367905902 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:49.705710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 234/471] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:49.730431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad3a0e-e57f-42b8-9168-57d3a092f74b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:49.817724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa9626-8623-4c9c-87d7-7bb367905902 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:49.862261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc7e6-7b4e-453f-8f95-b48121012350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:49.862952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc7e6-7b4e-453f-8f95-b48121012350 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.863519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc7e6-7b4e-453f-8f95-b48121012350 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.863799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc7e6-7b4e-453f-8f95-b48121012350 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.864671 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cc7e6-7b4e-453f-8f95-b48121012350 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:49.866517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cc7e6-7b4e-453f-8f95-b48121012350 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:49.877650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad3a0e-e57f-42b8-9168-57d3a092f74b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:49.895135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 238/472] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:49 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:49.926665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea416f0-d7f4-40d1-8bd2-005145fcb215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:49.927966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea416f0-d7f4-40d1-8bd2-005145fcb215 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.928441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea416f0-d7f4-40d1-8bd2-005145fcb215 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.928985 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea416f0-d7f4-40d1-8bd2-005145fcb215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.941646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea416f0-d7f4-40d1-8bd2-005145fcb215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:49.943594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea416f0-d7f4-40d1-8bd2-005145fcb215 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-dea416f0-d7f4-40d1-8bd2-005145fcb215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:49.962965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:49.963893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:49.964739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:49.964739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:49.964739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:49.964739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:49.967130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 235/473] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:49.974113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc7e6-7b4e-453f-8f95-b48121012350 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:49.980067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b03de-2986-4f00-baf2-b516b6f727de None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.980740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b03de-2986-4f00-baf2-b516b6f727de None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.981015 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b03de-2986-4f00-baf2-b516b6f727de None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:49.982820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 236/474] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:28:49.994030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0911f9-4ab1-468d-89d5-e0a2f5f10f9c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:49.994030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0911f9-4ab1-468d-89d5-e0a2f5f10f9c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:49.994030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0911f9-4ab1-468d-89d5-e0a2f5f10f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:50.014276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9c0911f9-4ab1-468d-89d5-e0a2f5f10f9c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:50.015712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9c0911f9-4ab1-468d-89d5-e0a2f5f10f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:50.118221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 237/475] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:50.127847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc7e6-7b4e-453f-8f95-b48121012350 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:50.137292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0911f9-4ab1-468d-89d5-e0a2f5f10f9c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:50.189238 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17dd37-d8dc-47eb-80d1-0fa21c5dd0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:50.190200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17dd37-d8dc-47eb-80d1-0fa21c5dd0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:50.190628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17dd37-d8dc-47eb-80d1-0fa21c5dd0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:50.191045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17dd37-d8dc-47eb-80d1-0fa21c5dd0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:50.192017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17dd37-d8dc-47eb-80d1-0fa21c5dd0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:50.192466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17dd37-d8dc-47eb-80d1-0fa21c5dd0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:50.194044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17dd37-d8dc-47eb-80d1-0fa21c5dd0e1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:50.206670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 239/476] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:50.212105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17dd37-d8dc-47eb-80d1-0fa21c5dd0e1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:50.252796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0911f9-4ab1-468d-89d5-e0a2f5f10f9c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:50.293790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:50.294508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:50.294784 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:50.295056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:50.295796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:50.297702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:50.310282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.sql.core [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 15:28:50.310282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 15:28:50.310282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [parameters: {'id': '43837affb91b4db4ae7f99eeb71a37b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 15:28:50.310282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() May 17 15:28:50.326837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return ref.to_dict() May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 15:28:50.327748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application yield resource May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.rollback() May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.force_reraise() May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise self.value May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application session.commit() May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 15:28:50.328765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._prepare_impl() May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.flush() May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._flush(objects) May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application compat.raise_( May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application flush_context.execute() May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rec.execute(self) May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 15:28:50.329594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 15:28:50.331318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 15:28:50.332112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [parameters: {'id': '43837affb91b4db4ae7f99eeb71a37b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:50.332881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 15:28:50.333673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:50.334551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 238/477] 10.222.0.75 () {60 vars in 1131 bytes} [Tue May 17 15:28:50 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:50.334551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:50.343509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17dd37-d8dc-47eb-80d1-0fa21c5dd0e1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:50.408265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664237-be0f-4c1a-9ddc-1a88ec0d317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:50.408855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664237-be0f-4c1a-9ddc-1a88ec0d317b None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:50.409132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664237-be0f-4c1a-9ddc-1a88ec0d317b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:50.409400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664237-be0f-4c1a-9ddc-1a88ec0d317b None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:50.410120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19664237-be0f-4c1a-9ddc-1a88ec0d317b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:50.411534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19664237-be0f-4c1a-9ddc-1a88ec0d317b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:50.453572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 240/478] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:50 2022] POST /identity/v3/users => generated 249 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:28:50.482528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e81d-0638-454c-8dd0-f192e42e3dfe None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:50.518471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede72dc-b104-4c38-a72e-7f45936c5aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:50.519296 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede72dc-b104-4c38-a72e-7f45936c5aac None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:50.519572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede72dc-b104-4c38-a72e-7f45936c5aac None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:50.519900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede72dc-b104-4c38-a72e-7f45936c5aac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:50.530798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede72dc-b104-4c38-a72e-7f45936c5aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1ede72dc-b104-4c38-a72e-7f45936c5aac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:50.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:50.541439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:50.543335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 239/479] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:28:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:50.546513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664237-be0f-4c1a-9ddc-1a88ec0d317b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:50.667458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664237-be0f-4c1a-9ddc-1a88ec0d317b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:50.709472 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea1933-f111-42a3-9e41-768c64606463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:50.710520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea1933-f111-42a3-9e41-768c64606463 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:50.711022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea1933-f111-42a3-9e41-768c64606463 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:50.711510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea1933-f111-42a3-9e41-768c64606463 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:50.712445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea1933-f111-42a3-9e41-768c64606463 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:50.712935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea1933-f111-42a3-9e41-768c64606463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:50.714529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea1933-f111-42a3-9e41-768c64606463 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:50.724454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 241/480] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:52.408964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180f1d0-8988-4e47-b29f-dd3a91cb007d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.409933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180f1d0-8988-4e47-b29f-dd3a91cb007d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.410447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180f1d0-8988-4e47-b29f-dd3a91cb007d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.412282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 240/481] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:52.417706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1aa8f-dc64-4cdc-92e0-26a8218aaf0d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.418532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1aa8f-dc64-4cdc-92e0-26a8218aaf0d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.419000 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1aa8f-dc64-4cdc-92e0-26a8218aaf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.436248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-01b1aa8f-dc64-4cdc-92e0-26a8218aaf0d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:52.437774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-01b1aa8f-dc64-4cdc-92e0-26a8218aaf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:52.455407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f24f-9b9d-4797-a34c-001b38ecf550 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.455712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f24f-9b9d-4797-a34c-001b38ecf550 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.455962 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f24f-9b9d-4797-a34c-001b38ecf550 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.457556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 241/482] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:28:52.462549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7731074-2a0d-4172-b4b4-cda71f8d52fd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.463000 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7731074-2a0d-4172-b4b4-cda71f8d52fd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.463283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7731074-2a0d-4172-b4b4-cda71f8d52fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.483137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b7731074-2a0d-4172-b4b4-cda71f8d52fd None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:52.484975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b7731074-2a0d-4172-b4b4-cda71f8d52fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:52.545154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 242/483] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:52.573371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 242/484] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:52.579734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1aa8f-dc64-4cdc-92e0-26a8218aaf0d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:52.639575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7731074-2a0d-4172-b4b4-cda71f8d52fd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:52.740225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1aa8f-dc64-4cdc-92e0-26a8218aaf0d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:52.784652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7731074-2a0d-4172-b4b4-cda71f8d52fd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:52.785144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208331-4fa5-4343-82e2-67f685a16772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:52.786174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208331-4fa5-4343-82e2-67f685a16772 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.786660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208331-4fa5-4343-82e2-67f685a16772 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.787123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208331-4fa5-4343-82e2-67f685a16772 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.797484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08208331-4fa5-4343-82e2-67f685a16772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-08208331-4fa5-4343-82e2-67f685a16772 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:52.805322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:52.806227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:52.807016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:52.809610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 243/485] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:28:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:52.815388 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208331-4fa5-4343-82e2-67f685a16772 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:52.818186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e4e78-0280-409e-a633-4c782849ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:52.818923 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e4e78-0280-409e-a633-4c782849ad44 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.819203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e4e78-0280-409e-a633-4c782849ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.819476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e4e78-0280-409e-a633-4c782849ad44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.830933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e4e78-0280-409e-a633-4c782849ad44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9a9e4e78-0280-409e-a633-4c782849ad44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:52.838466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:52.839371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:52.840160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 243/486] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:28:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:52.841294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a482d8d-d8da-4eb2-bea3-6d7c1e93f31d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.841451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a482d8d-d8da-4eb2-bea3-6d7c1e93f31d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.841691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a482d8d-d8da-4eb2-bea3-6d7c1e93f31d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.848423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 244/487] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:52.849175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a482d8d-d8da-4eb2-bea3-6d7c1e93f31d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:52.925229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208331-4fa5-4343-82e2-67f685a16772 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:52.952131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a482d8d-d8da-4eb2-bea3-6d7c1e93f31d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:52.959655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b37c1-894d-4a91-9ef2-6d9ea5283776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:52.960603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b37c1-894d-4a91-9ef2-6d9ea5283776 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.961076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b37c1-894d-4a91-9ef2-6d9ea5283776 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.961538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b37c1-894d-4a91-9ef2-6d9ea5283776 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.962517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b37c1-894d-4a91-9ef2-6d9ea5283776 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:52.963206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b37c1-894d-4a91-9ef2-6d9ea5283776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:52.964748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b37c1-894d-4a91-9ef2-6d9ea5283776 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:52.978032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 244/488] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:28:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:52.979700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3bb83-0c87-423c-896f-bc8590ac960f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.980200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3bb83-0c87-423c-896f-bc8590ac960f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.980677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3bb83-0c87-423c-896f-bc8590ac960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.987122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad515ed-174c-4da1-8ad3-61e814da0ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:52.987786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad515ed-174c-4da1-8ad3-61e814da0ecb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:52.988071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad515ed-174c-4da1-8ad3-61e814da0ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:52.988346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad515ed-174c-4da1-8ad3-61e814da0ecb None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:52.989085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad515ed-174c-4da1-8ad3-61e814da0ecb None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:52.989388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad515ed-174c-4da1-8ad3-61e814da0ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:52.990860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad515ed-174c-4da1-8ad3-61e814da0ecb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:52.998896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4df3bb83-0c87-423c-896f-bc8590ac960f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:52.999361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 245/489] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:28:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:53.000709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad515ed-174c-4da1-8ad3-61e814da0ecb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.001315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4df3bb83-0c87-423c-896f-bc8590ac960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:53.081492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 245/490] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:53.082694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3bb83-0c87-423c-896f-bc8590ac960f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.107859 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad515ed-174c-4da1-8ad3-61e814da0ecb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.141896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5f714-c123-4b13-8b40-133773d5a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.142727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5f714-c123-4b13-8b40-133773d5a567 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.143090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5f714-c123-4b13-8b40-133773d5a567 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.143277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5f714-c123-4b13-8b40-133773d5a567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.153817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5f714-c123-4b13-8b40-133773d5a567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:53.155322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5f714-c123-4b13-8b40-133773d5a567 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-88e5f714-c123-4b13-8b40-133773d5a567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:53.172232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:53.173090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:53.173926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:53.173926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:53.173926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:53.173926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:53.173926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 246/491] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:53.179048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5f714-c123-4b13-8b40-133773d5a567 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.186760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3bb83-0c87-423c-896f-bc8590ac960f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.224330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7cd3f-351a-4c0f-b1ac-f25a93bafed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.225324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7cd3f-351a-4c0f-b1ac-f25a93bafed2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.225840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7cd3f-351a-4c0f-b1ac-f25a93bafed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.226329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7cd3f-351a-4c0f-b1ac-f25a93bafed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.237287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7cd3f-351a-4c0f-b1ac-f25a93bafed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:53.239100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7cd3f-351a-4c0f-b1ac-f25a93bafed2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9ff7cd3f-351a-4c0f-b1ac-f25a93bafed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:53.257207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:53.258355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:53.259206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:53.259206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:53.259206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:53.259206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:53.260917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 246/492] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:53.261874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7cd3f-351a-4c0f-b1ac-f25a93bafed2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.288759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5f714-c123-4b13-8b40-133773d5a567 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.325910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ec97f-a56b-4198-980a-6a88092e3645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.326753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ec97f-a56b-4198-980a-6a88092e3645 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.327032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ec97f-a56b-4198-980a-6a88092e3645 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.327300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ec97f-a56b-4198-980a-6a88092e3645 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.337616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ec97f-a56b-4198-980a-6a88092e3645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7f0ec97f-a56b-4198-980a-6a88092e3645 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:53.345333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:53.346571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:53.347392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 247/493] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:53.348036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ec97f-a56b-4198-980a-6a88092e3645 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.371881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7cd3f-351a-4c0f-b1ac-f25a93bafed2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.406149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03734b6d-6dfb-4aee-a0f1-d024e79d7e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.406814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03734b6d-6dfb-4aee-a0f1-d024e79d7e51 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.407092 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03734b6d-6dfb-4aee-a0f1-d024e79d7e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.407369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03734b6d-6dfb-4aee-a0f1-d024e79d7e51 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.408078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03734b6d-6dfb-4aee-a0f1-d024e79d7e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:53.408376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03734b6d-6dfb-4aee-a0f1-d024e79d7e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:53.409723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03734b6d-6dfb-4aee-a0f1-d024e79d7e51 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:53.420675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 247/494] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:53.423167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03734b6d-6dfb-4aee-a0f1-d024e79d7e51 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.448169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ec97f-a56b-4198-980a-6a88092e3645 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.482763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811f1a2-1812-45bf-bf06-cc7b92d8775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.483502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f1a2-1812-45bf-bf06-cc7b92d8775b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.483846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f1a2-1812-45bf-bf06-cc7b92d8775b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.484644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f1a2-1812-45bf-bf06-cc7b92d8775b None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.485389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811f1a2-1812-45bf-bf06-cc7b92d8775b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:53.485695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811f1a2-1812-45bf-bf06-cc7b92d8775b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:53.487116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811f1a2-1812-45bf-bf06-cc7b92d8775b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:53.498406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 248/495] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:53.500185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f395-ed6b-43bf-a962-be06298235cb None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.500476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f395-ed6b-43bf-a962-be06298235cb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.500754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f395-ed6b-43bf-a962-be06298235cb None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.501969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 249/496] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:53.503831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f395-ed6b-43bf-a962-be06298235cb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.522324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03734b6d-6dfb-4aee-a0f1-d024e79d7e51 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.553223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae34b3-4285-4be0-9f94-797bb5e8bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.553873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae34b3-4285-4be0-9f94-797bb5e8bf94 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.554183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae34b3-4285-4be0-9f94-797bb5e8bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.554464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae34b3-4285-4be0-9f94-797bb5e8bf94 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.555200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae34b3-4285-4be0-9f94-797bb5e8bf94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:53.555519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae34b3-4285-4be0-9f94-797bb5e8bf94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:53.556861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae34b3-4285-4be0-9f94-797bb5e8bf94 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:53.565009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 248/497] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:53.566259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8450-d48d-4d2f-ad31-4ae6bdf86574 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.566548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8450-d48d-4d2f-ad31-4ae6bdf86574 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.566821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8450-d48d-4d2f-ad31-4ae6bdf86574 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.569534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 249/498] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:53.569534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8450-d48d-4d2f-ad31-4ae6bdf86574 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.600175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f395-ed6b-43bf-a962-be06298235cb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.632752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54a96e-afef-4205-9ef4-4037f12d82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.633538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54a96e-afef-4205-9ef4-4037f12d82dc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.633819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54a96e-afef-4205-9ef4-4037f12d82dc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.634118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54a96e-afef-4205-9ef4-4037f12d82dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.640800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54a96e-afef-4205-9ef4-4037f12d82dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:53.642292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54a96e-afef-4205-9ef4-4037f12d82dc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3f54a96e-afef-4205-9ef4-4037f12d82dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:28:53.658235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:53.659152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:53.660026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 250/499] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:53.660589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6c177-0949-4513-bedd-495cf77fd666 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.661201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6c177-0949-4513-bedd-495cf77fd666 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.661201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6c177-0949-4513-bedd-495cf77fd666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.668955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8450-d48d-4d2f-ad31-4ae6bdf86574 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.676904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-08f6c177-0949-4513-bedd-495cf77fd666 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:53.678126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-08f6c177-0949-4513-bedd-495cf77fd666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:53.701383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574b04b-018e-4c7a-abc9-797237da5d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.702199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b04b-018e-4c7a-abc9-797237da5d37 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.702478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b04b-018e-4c7a-abc9-797237da5d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.702746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b04b-018e-4c7a-abc9-797237da5d37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.709766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574b04b-018e-4c7a-abc9-797237da5d37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:53.711241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574b04b-018e-4c7a-abc9-797237da5d37 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-5574b04b-018e-4c7a-abc9-797237da5d37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:28:53.726488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:53.727396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:53.728301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 250/500] 10.222.0.75 () {56 vars in 1093 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:53.728887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574b04b-018e-4c7a-abc9-797237da5d37 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.743944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 251/501] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:53.745266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46353cc1-234a-4af2-b038-5dedbb989e40 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.745623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46353cc1-234a-4af2-b038-5dedbb989e40 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.745952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46353cc1-234a-4af2-b038-5dedbb989e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.760964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-46353cc1-234a-4af2-b038-5dedbb989e40 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:53.762172 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-46353cc1-234a-4af2-b038-5dedbb989e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:53.822947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 252/502] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:53.823676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46353cc1-234a-4af2-b038-5dedbb989e40 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.837816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574b04b-018e-4c7a-abc9-797237da5d37 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.872478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4640b-6841-4d1b-b12a-abf0eded4a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.873254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4640b-6841-4d1b-b12a-abf0eded4a4d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.873540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4640b-6841-4d1b-b12a-abf0eded4a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.873809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4640b-6841-4d1b-b12a-abf0eded4a4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.883789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4640b-6841-4d1b-b12a-abf0eded4a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:53.885225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4640b-6841-4d1b-b12a-abf0eded4a4d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-5cc4640b-6841-4d1b-b12a-abf0eded4a4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:53.901155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:53.901991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:53.902899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:53.902899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:53.902899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:53.902899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:53.902899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 251/503] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:53.903249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4640b-6841-4d1b-b12a-abf0eded4a4d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.921250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46353cc1-234a-4af2-b038-5dedbb989e40 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:53.953259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab3ef-8b86-4ca9-bf15-372036b86077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:53.953927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab3ef-8b86-4ca9-bf15-372036b86077 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:53.954244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab3ef-8b86-4ca9-bf15-372036b86077 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:53.954521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab3ef-8b86-4ca9-bf15-372036b86077 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:53.955350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ab3ef-8b86-4ca9-bf15-372036b86077 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:53.955658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ab3ef-8b86-4ca9-bf15-372036b86077 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:53.957104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ab3ef-8b86-4ca9-bf15-372036b86077 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:53.993287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 253/504] 10.222.0.75 () {56 vars in 1137 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:53.993903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab3ef-8b86-4ca9-bf15-372036b86077 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:53.994666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4640b-6841-4d1b-b12a-abf0eded4a4d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.025684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590c996-a318-4c24-9864-d3ff463f522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.026382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590c996-a318-4c24-9864-d3ff463f522e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.026664 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590c996-a318-4c24-9864-d3ff463f522e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.026938 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590c996-a318-4c24-9864-d3ff463f522e None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.027769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590c996-a318-4c24-9864-d3ff463f522e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:54.028173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590c996-a318-4c24-9864-d3ff463f522e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.029601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590c996-a318-4c24-9864-d3ff463f522e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.065843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 252/505] 10.222.0.75 () {56 vars in 1133 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:54.066678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590c996-a318-4c24-9864-d3ff463f522e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.085482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab3ef-8b86-4ca9-bf15-372036b86077 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.117203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d48bb7-7cf6-413d-9ccf-aeb74d864d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.117978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d48bb7-7cf6-413d-9ccf-aeb74d864d32 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.118282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d48bb7-7cf6-413d-9ccf-aeb74d864d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.118553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d48bb7-7cf6-413d-9ccf-aeb74d864d32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.128001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d48bb7-7cf6-413d-9ccf-aeb74d864d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-94d48bb7-7cf6-413d-9ccf-aeb74d864d32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:54.135567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:54.136616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:54.137431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 254/506] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:54.138117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d48bb7-7cf6-413d-9ccf-aeb74d864d32 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.162893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590c996-a318-4c24-9864-d3ff463f522e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.193784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9af5be-1561-4b71-a99a-be8d3fdb8de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.194593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9af5be-1561-4b71-a99a-be8d3fdb8de2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.194870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9af5be-1561-4b71-a99a-be8d3fdb8de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.195138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9af5be-1561-4b71-a99a-be8d3fdb8de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.204864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9af5be-1561-4b71-a99a-be8d3fdb8de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.206347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9af5be-1561-4b71-a99a-be8d3fdb8de2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-0b9af5be-1561-4b71-a99a-be8d3fdb8de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:54.224969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:54.225829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:54.226976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:54.226976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:54.226976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:54.226976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:54.230387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 253/507] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:54.231113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9af5be-1561-4b71-a99a-be8d3fdb8de2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.236269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d48bb7-7cf6-413d-9ccf-aeb74d864d32 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.268058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56210ee4-16ce-478b-84dc-7be9d7d5cfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.268708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56210ee4-16ce-478b-84dc-7be9d7d5cfea None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.268988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56210ee4-16ce-478b-84dc-7be9d7d5cfea None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.269260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56210ee4-16ce-478b-84dc-7be9d7d5cfea None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.269971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56210ee4-16ce-478b-84dc-7be9d7d5cfea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:54.270303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56210ee4-16ce-478b-84dc-7be9d7d5cfea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.271680 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56210ee4-16ce-478b-84dc-7be9d7d5cfea None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.283218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 255/508] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:54.283992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56210ee4-16ce-478b-84dc-7be9d7d5cfea None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.324052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9af5be-1561-4b71-a99a-be8d3fdb8de2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.356275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5afd3-c672-4a95-bcf5-02ff4a4987f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.356918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5afd3-c672-4a95-bcf5-02ff4a4987f5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.357200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5afd3-c672-4a95-bcf5-02ff4a4987f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.357474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5afd3-c672-4a95-bcf5-02ff4a4987f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.374277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56210ee4-16ce-478b-84dc-7be9d7d5cfea None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.411552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889bd6f-eb55-4158-b570-d79ba51c80e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.412190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889bd6f-eb55-4158-b570-d79ba51c80e2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.412475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889bd6f-eb55-4158-b570-d79ba51c80e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.412743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889bd6f-eb55-4158-b570-d79ba51c80e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.422565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5afd3-c672-4a95-bcf5-02ff4a4987f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.424028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5afd3-c672-4a95-bcf5-02ff4a4987f5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.475211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889bd6f-eb55-4158-b570-d79ba51c80e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.476657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889bd6f-eb55-4158-b570-d79ba51c80e2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.518642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 254/509] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:54.519478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5afd3-c672-4a95-bcf5-02ff4a4987f5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.570889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 256/510] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:54.571781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889bd6f-eb55-4158-b570-d79ba51c80e2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.613334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5afd3-c672-4a95-bcf5-02ff4a4987f5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.643936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e47657-8c62-492c-889f-33c47a8ad18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.644588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e47657-8c62-492c-889f-33c47a8ad18b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.644866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e47657-8c62-492c-889f-33c47a8ad18b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.645138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e47657-8c62-492c-889f-33c47a8ad18b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.645874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e47657-8c62-492c-889f-33c47a8ad18b None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:54.646212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e47657-8c62-492c-889f-33c47a8ad18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.647568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e47657-8c62-492c-889f-33c47a8ad18b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.655071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 255/511] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:54.656400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e47657-8c62-492c-889f-33c47a8ad18b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.667966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889bd6f-eb55-4158-b570-d79ba51c80e2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.700833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03a822-cbf6-48ef-84d1-27dd53fbb19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.701492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03a822-cbf6-48ef-84d1-27dd53fbb19f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.701774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03a822-cbf6-48ef-84d1-27dd53fbb19f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.702077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03a822-cbf6-48ef-84d1-27dd53fbb19f None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.703429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03a822-cbf6-48ef-84d1-27dd53fbb19f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:54.703732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03a822-cbf6-48ef-84d1-27dd53fbb19f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.705133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03a822-cbf6-48ef-84d1-27dd53fbb19f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.715719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 257/512] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:54.716490 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03a822-cbf6-48ef-84d1-27dd53fbb19f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.748472 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e47657-8c62-492c-889f-33c47a8ad18b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.779953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6138e-f6b4-4db0-9844-3d4fb28b8e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.780754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6138e-f6b4-4db0-9844-3d4fb28b8e3c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.781538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6138e-f6b4-4db0-9844-3d4fb28b8e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.781809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6138e-f6b4-4db0-9844-3d4fb28b8e3c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.788936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6138e-f6b4-4db0-9844-3d4fb28b8e3c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.790415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6138e-f6b4-4db0-9844-3d4fb28b8e3c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-62a6138e-f6b4-4db0-9844-3d4fb28b8e3c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:28:54.804415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:54.805321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 256/513] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:54.806703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6138e-f6b4-4db0-9844-3d4fb28b8e3c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.816324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03a822-cbf6-48ef-84d1-27dd53fbb19f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.848831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed304478-a60f-45d1-9c0c-3b9d24faa574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.849606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed304478-a60f-45d1-9c0c-3b9d24faa574 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.849885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed304478-a60f-45d1-9c0c-3b9d24faa574 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.850192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed304478-a60f-45d1-9c0c-3b9d24faa574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.860714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed304478-a60f-45d1-9c0c-3b9d24faa574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.862195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed304478-a60f-45d1-9c0c-3b9d24faa574 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ed304478-a60f-45d1-9c0c-3b9d24faa574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:54.878956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:54.879775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:54.880659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:54.880659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:54.880659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:54.880659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:54.880659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 258/514] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:54.881395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed304478-a60f-45d1-9c0c-3b9d24faa574 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.900496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6138e-f6b4-4db0-9844-3d4fb28b8e3c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:54.931746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569467d-a1a5-4427-9d24-32410c9b41ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:54.932519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569467d-a1a5-4427-9d24-32410c9b41ec None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:54.932797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569467d-a1a5-4427-9d24-32410c9b41ec None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:54.933072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569467d-a1a5-4427-9d24-32410c9b41ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:54.943538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569467d-a1a5-4427-9d24-32410c9b41ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:54.944982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569467d-a1a5-4427-9d24-32410c9b41ec None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a569467d-a1a5-4427-9d24-32410c9b41ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:54.961056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:54.962120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:54.963207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:54.963207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:54.963207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:54.963207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:54.963207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 257/515] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:54.963207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569467d-a1a5-4427-9d24-32410c9b41ec None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:54.980998 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed304478-a60f-45d1-9c0c-3b9d24faa574 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.012711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b063d-2d3b-46a1-9dab-f0e05c915851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.013486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b063d-2d3b-46a1-9dab-f0e05c915851 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.013769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b063d-2d3b-46a1-9dab-f0e05c915851 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.014069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b063d-2d3b-46a1-9dab-f0e05c915851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.023896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b063d-2d3b-46a1-9dab-f0e05c915851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.025346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b063d-2d3b-46a1-9dab-f0e05c915851 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ff6b063d-2d3b-46a1-9dab-f0e05c915851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:55.041891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:55.042902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:55.043812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:55.043812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:55.043812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:55.043812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:55.043812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 259/516] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:55.043812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b063d-2d3b-46a1-9dab-f0e05c915851 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.055857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569467d-a1a5-4427-9d24-32410c9b41ec None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.087352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2f69c-e646-496b-a2cc-90ec6621a241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.088011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2f69c-e646-496b-a2cc-90ec6621a241 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.088293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2f69c-e646-496b-a2cc-90ec6621a241 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.088568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2f69c-e646-496b-a2cc-90ec6621a241 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.089260 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2f69c-e646-496b-a2cc-90ec6621a241 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.090707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2f69c-e646-496b-a2cc-90ec6621a241 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.110648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 258/517] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:28:54 2022] POST /identity/v3/users => generated 247 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:28:55.111609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2f69c-e646-496b-a2cc-90ec6621a241 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.141762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b063d-2d3b-46a1-9dab-f0e05c915851 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.178703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd790e4-fa7c-41da-a38b-ffccfa701872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.179391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd790e4-fa7c-41da-a38b-ffccfa701872 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.179677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd790e4-fa7c-41da-a38b-ffccfa701872 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.179953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd790e4-fa7c-41da-a38b-ffccfa701872 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.180799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd790e4-fa7c-41da-a38b-ffccfa701872 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:55.181114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd790e4-fa7c-41da-a38b-ffccfa701872 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.182641 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd790e4-fa7c-41da-a38b-ffccfa701872 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.206800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 260/518] 10.222.0.75 () {56 vars in 1137 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:55.206800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd790e4-fa7c-41da-a38b-ffccfa701872 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.217848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2f69c-e646-496b-a2cc-90ec6621a241 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.255514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de23970-626f-4b14-a87f-89e3dcd4c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.256186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de23970-626f-4b14-a87f-89e3dcd4c847 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.256466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de23970-626f-4b14-a87f-89e3dcd4c847 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.256738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de23970-626f-4b14-a87f-89e3dcd4c847 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.257475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de23970-626f-4b14-a87f-89e3dcd4c847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:55.257783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de23970-626f-4b14-a87f-89e3dcd4c847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.259226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de23970-626f-4b14-a87f-89e3dcd4c847 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.272356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 259/519] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:55.274262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de23970-626f-4b14-a87f-89e3dcd4c847 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.307118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd790e4-fa7c-41da-a38b-ffccfa701872 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.341819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a608f-3026-495c-bb57-18dc93075efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.342520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a608f-3026-495c-bb57-18dc93075efe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.342798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a608f-3026-495c-bb57-18dc93075efe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.343071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a608f-3026-495c-bb57-18dc93075efe None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.344337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a608f-3026-495c-bb57-18dc93075efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:55.344627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a608f-3026-495c-bb57-18dc93075efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.346293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a608f-3026-495c-bb57-18dc93075efe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.357539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 261/520] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:55.359415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a608f-3026-495c-bb57-18dc93075efe None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.378952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de23970-626f-4b14-a87f-89e3dcd4c847 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.412091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b8c3f-71c5-4ade-9b3b-08ea5f208ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.413056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b8c3f-71c5-4ade-9b3b-08ea5f208ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.413567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b8c3f-71c5-4ade-9b3b-08ea5f208ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.413906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b8c3f-71c5-4ade-9b3b-08ea5f208ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.414738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b8c3f-71c5-4ade-9b3b-08ea5f208ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:55.415107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b8c3f-71c5-4ade-9b3b-08ea5f208ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.416548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b8c3f-71c5-4ade-9b3b-08ea5f208ed9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.428421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 260/521] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:55.429934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b8c3f-71c5-4ade-9b3b-08ea5f208ed9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.456427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a608f-3026-495c-bb57-18dc93075efe None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.489744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb146e-1a00-4369-adde-1cfe1474dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.490526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb146e-1a00-4369-adde-1cfe1474dc7c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.490721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb146e-1a00-4369-adde-1cfe1474dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.490959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb146e-1a00-4369-adde-1cfe1474dc7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.527548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b8c3f-71c5-4ade-9b3b-08ea5f208ed9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.555325 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb146e-1a00-4369-adde-1cfe1474dc7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.556784 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb146e-1a00-4369-adde-1cfe1474dc7c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.561627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8ba65-5f06-4821-8834-c54528811ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.562449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8ba65-5f06-4821-8834-c54528811ebb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.562732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8ba65-5f06-4821-8834-c54528811ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.563003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8ba65-5f06-4821-8834-c54528811ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.569607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8ba65-5f06-4821-8834-c54528811ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.571082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8ba65-5f06-4821-8834-c54528811ebb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-52b8ba65-5f06-4821-8834-c54528811ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:28:55.585869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:55.586929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 261/522] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:55.587809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8ba65-5f06-4821-8834-c54528811ebb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.661159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 262/523] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:55.661159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb146e-1a00-4369-adde-1cfe1474dc7c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.688196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8ba65-5f06-4821-8834-c54528811ebb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.722630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29638d-cfb0-4f53-a20f-cd45e225d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.723421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29638d-cfb0-4f53-a20f-cd45e225d95d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.723701 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29638d-cfb0-4f53-a20f-cd45e225d95d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.723971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29638d-cfb0-4f53-a20f-cd45e225d95d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.730632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29638d-cfb0-4f53-a20f-cd45e225d95d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.732065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29638d-cfb0-4f53-a20f-cd45e225d95d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-da29638d-cfb0-4f53-a20f-cd45e225d95d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:28:55.745490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:55.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 262/524] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:55.747467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29638d-cfb0-4f53-a20f-cd45e225d95d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.754585 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb146e-1a00-4369-adde-1cfe1474dc7c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.787667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563f390-9a92-42a8-908c-2a84c180eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.788446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563f390-9a92-42a8-908c-2a84c180eb16 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.788720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563f390-9a92-42a8-908c-2a84c180eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.788988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563f390-9a92-42a8-908c-2a84c180eb16 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.795754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563f390-9a92-42a8-908c-2a84c180eb16 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.797138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563f390-9a92-42a8-908c-2a84c180eb16 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5563f390-9a92-42a8-908c-2a84c180eb16 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:28:55.811369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:55.812361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 263/525] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:55.818073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563f390-9a92-42a8-908c-2a84c180eb16 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.845754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29638d-cfb0-4f53-a20f-cd45e225d95d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.877932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4bc0d-6da1-45a5-ab82-878e1652a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.878618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4bc0d-6da1-45a5-ab82-878e1652a33d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.878901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4bc0d-6da1-45a5-ab82-878e1652a33d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.879174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4bc0d-6da1-45a5-ab82-878e1652a33d None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.879965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4bc0d-6da1-45a5-ab82-878e1652a33d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:55.880273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4bc0d-6da1-45a5-ab82-878e1652a33d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.881696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4bc0d-6da1-45a5-ab82-878e1652a33d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.899703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 263/526] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:55.900528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4bc0d-6da1-45a5-ab82-878e1652a33d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.913993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563f390-9a92-42a8-908c-2a84c180eb16 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:55.946581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bedda-bf52-475b-9c49-6a1c6b73eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:55.947292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bedda-bf52-475b-9c49-6a1c6b73eb18 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:55.947569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bedda-bf52-475b-9c49-6a1c6b73eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:55.947844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bedda-bf52-475b-9c49-6a1c6b73eb18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:55.958151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bedda-bf52-475b-9c49-6a1c6b73eb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:55.959628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bedda-bf52-475b-9c49-6a1c6b73eb18 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d75bedda-bf52-475b-9c49-6a1c6b73eb18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:55.976801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:55.977682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:55.978622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:55.978622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:55.978622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:55.978622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:55.982314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 264/527] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:55.983363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bedda-bf52-475b-9c49-6a1c6b73eb18 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:55.999389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4bc0d-6da1-45a5-ab82-878e1652a33d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.032921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3de6b-f827-498b-a3d2-e485e01e16bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.033571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3de6b-f827-498b-a3d2-e485e01e16bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.033857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3de6b-f827-498b-a3d2-e485e01e16bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.034156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3de6b-f827-498b-a3d2-e485e01e16bf None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.034936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3de6b-f827-498b-a3d2-e485e01e16bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:56.035241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3de6b-f827-498b-a3d2-e485e01e16bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.036688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3de6b-f827-498b-a3d2-e485e01e16bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.047978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 264/528] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:56.048665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3de6b-f827-498b-a3d2-e485e01e16bf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:56.080134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bedda-bf52-475b-9c49-6a1c6b73eb18 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.111684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb277d5-f308-492a-8f62-2997edd42dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.112455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb277d5-f308-492a-8f62-2997edd42dfa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.112830 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb277d5-f308-492a-8f62-2997edd42dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.113223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb277d5-f308-492a-8f62-2997edd42dfa None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.114173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb277d5-f308-492a-8f62-2997edd42dfa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:56.114575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb277d5-f308-492a-8f62-2997edd42dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.116104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb277d5-f308-492a-8f62-2997edd42dfa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.132620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 265/529] 10.222.0.75 () {56 vars in 1139 bytes} [Tue May 17 15:28:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:56.134489 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb277d5-f308-492a-8f62-2997edd42dfa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:56.144407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3de6b-f827-498b-a3d2-e485e01e16bf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.176349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef9d70-d555-45e1-be7d-fefad7269f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.176991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef9d70-d555-45e1-be7d-fefad7269f42 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.177277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef9d70-d555-45e1-be7d-fefad7269f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.177548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef9d70-d555-45e1-be7d-fefad7269f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.178399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef9d70-d555-45e1-be7d-fefad7269f42 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=22c0e889e1f842b2a6081f38aabd97ac) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:56.178711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef9d70-d555-45e1-be7d-fefad7269f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.180127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef9d70-d555-45e1-be7d-fefad7269f42 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.192086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 265/530] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/role_assignments?user.id=22c0e889e1f842b2a6081f38aabd97ac&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:56.192086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef9d70-d555-45e1-be7d-fefad7269f42 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:56.243650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb277d5-f308-492a-8f62-2997edd42dfa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.283004 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845964c2-6797-4587-bb73-eb6c30d27dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.283798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845964c2-6797-4587-bb73-eb6c30d27dfc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.284150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845964c2-6797-4587-bb73-eb6c30d27dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.284495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845964c2-6797-4587-bb73-eb6c30d27dfc None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.285305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845964c2-6797-4587-bb73-eb6c30d27dfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:56.285683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845964c2-6797-4587-bb73-eb6c30d27dfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.287316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845964c2-6797-4587-bb73-eb6c30d27dfc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.301073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 266/531] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:56.301953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845964c2-6797-4587-bb73-eb6c30d27dfc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:56.321942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef9d70-d555-45e1-be7d-fefad7269f42 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.357753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb16db0-aa5c-4ca1-9139-ecacefe98835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.358473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb16db0-aa5c-4ca1-9139-ecacefe98835 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.358756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb16db0-aa5c-4ca1-9139-ecacefe98835 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.359561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb16db0-aa5c-4ca1-9139-ecacefe98835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.360402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb16db0-aa5c-4ca1-9139-ecacefe98835 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8ef90c1c9c784d8792b3afe6e8e7fb31) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:56.360712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb16db0-aa5c-4ca1-9139-ecacefe98835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.362238 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb16db0-aa5c-4ca1-9139-ecacefe98835 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.374307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 266/532] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/role_assignments?user.id=8ef90c1c9c784d8792b3afe6e8e7fb31&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:56.377377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb16db0-aa5c-4ca1-9139-ecacefe98835 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:56.414938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845964c2-6797-4587-bb73-eb6c30d27dfc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.455565 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784975b2-e271-49c9-9f94-866ec4d7e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.455780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784975b2-e271-49c9-9f94-866ec4d7e11e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.456097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784975b2-e271-49c9-9f94-866ec4d7e11e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.456375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784975b2-e271-49c9-9f94-866ec4d7e11e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.489258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb16db0-aa5c-4ca1-9139-ecacefe98835 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.527520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7b290-644d-4d20-b6c1-0659e352bea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.528651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7b290-644d-4d20-b6c1-0659e352bea6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.529127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7b290-644d-4d20-b6c1-0659e352bea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.529587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7b290-644d-4d20-b6c1-0659e352bea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.532511 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784975b2-e271-49c9-9f94-866ec4d7e11e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.534023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784975b2-e271-49c9-9f94-866ec4d7e11e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.538571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7b290-644d-4d20-b6c1-0659e352bea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.540336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7b290-644d-4d20-b6c1-0659e352bea6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-5ca7b290-644d-4d20-b6c1-0659e352bea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:28:56.555340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:56.556254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:56.557094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:28:56.557094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:28:56.557094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:28:56.557094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:28:56.557094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:28:56.557094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:28:56.557094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:28:56.557094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:56.559630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 267/533] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:56.565677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7b290-644d-4d20-b6c1-0659e352bea6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:56.643638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 267/534] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:56.644883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784975b2-e271-49c9-9f94-866ec4d7e11e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:56.670141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7b290-644d-4d20-b6c1-0659e352bea6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.705052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8c5fc-4073-4c58-a866-9462d06cb86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.706097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8c5fc-4073-4c58-a866-9462d06cb86f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.706601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8c5fc-4073-4c58-a866-9462d06cb86f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.707067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8c5fc-4073-4c58-a866-9462d06cb86f None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.708059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8c5fc-4073-4c58-a866-9462d06cb86f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:56.708556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8c5fc-4073-4c58-a866-9462d06cb86f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.710315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8c5fc-4073-4c58-a866-9462d06cb86f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.722835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 268/535] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:56.728740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8c5fc-4073-4c58-a866-9462d06cb86f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:56.746730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784975b2-e271-49c9-9f94-866ec4d7e11e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.781584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376804f-e749-4253-af1d-ede03227eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.782335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376804f-e749-4253-af1d-ede03227eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.782627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376804f-e749-4253-af1d-ede03227eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.782905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376804f-e749-4253-af1d-ede03227eeb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.793514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376804f-e749-4253-af1d-ede03227eeb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.794793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376804f-e749-4253-af1d-ede03227eeb6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3376804f-e749-4253-af1d-ede03227eeb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:56.813232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:56.814177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:56.815107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:56.815107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:56.815107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:56.815107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:56.818106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 268/536] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:56.820217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376804f-e749-4253-af1d-ede03227eeb6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:56.835476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8c5fc-4073-4c58-a866-9462d06cb86f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.868646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f107e5-3244-4555-9001-1673ab569889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.869640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f107e5-3244-4555-9001-1673ab569889 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.870173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f107e5-3244-4555-9001-1673ab569889 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.870638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f107e5-3244-4555-9001-1673ab569889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.871648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f107e5-3244-4555-9001-1673ab569889 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=3196743ff7564c16b3cfdae4f0008075) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:56.872168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f107e5-3244-4555-9001-1673ab569889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.873842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f107e5-3244-4555-9001-1673ab569889 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.880456 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 269/537] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/role_assignments?user.id=3196743ff7564c16b3cfdae4f0008075&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:56.926647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376804f-e749-4253-af1d-ede03227eeb6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:56.964337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878232a-2ffc-42a0-9d57-fdb7ba70311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:56.965025 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878232a-2ffc-42a0-9d57-fdb7ba70311a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:56.965311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878232a-2ffc-42a0-9d57-fdb7ba70311a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:56.965587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878232a-2ffc-42a0-9d57-fdb7ba70311a None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:56.966356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878232a-2ffc-42a0-9d57-fdb7ba70311a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:56.966664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878232a-2ffc-42a0-9d57-fdb7ba70311a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:56.968057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878232a-2ffc-42a0-9d57-fdb7ba70311a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:56.985884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 269/538] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:56.987285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f107e5-3244-4555-9001-1673ab569889 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:57.108198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f107e5-3244-4555-9001-1673ab569889 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:57.144286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bb796-6826-40be-9b0b-74eda4a31f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:57.145155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bb796-6826-40be-9b0b-74eda4a31f20 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:57.145357 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bb796-6826-40be-9b0b-74eda4a31f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:57.145632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bb796-6826-40be-9b0b-74eda4a31f20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:57.155466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bb796-6826-40be-9b0b-74eda4a31f20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:57.157228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bb796-6826-40be-9b0b-74eda4a31f20 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-707bb796-6826-40be-9b0b-74eda4a31f20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:28:57.172419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:57.173305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:57.174208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:28:57.174208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:28:57.174208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:28:57.174208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:28:57.174208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:28:57.174208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:28:57.174208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:28:57.174208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:57.176360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 270/539] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:28:57.182241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878232a-2ffc-42a0-9d57-fdb7ba70311a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:57.289510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878232a-2ffc-42a0-9d57-fdb7ba70311a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:57.329546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d0825-7491-4636-b89d-5ab0d107d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:57.330251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0825-7491-4636-b89d-5ab0d107d56e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:57.330540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0825-7491-4636-b89d-5ab0d107d56e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:57.330821 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0825-7491-4636-b89d-5ab0d107d56e None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:57.331674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d0825-7491-4636-b89d-5ab0d107d56e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:57.331990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d0825-7491-4636-b89d-5ab0d107d56e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:57.333441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d0825-7491-4636-b89d-5ab0d107d56e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:57.357364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 270/540] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:57.361520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bb796-6826-40be-9b0b-74eda4a31f20 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:57.475278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bb796-6826-40be-9b0b-74eda4a31f20 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:57.505828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb6165-1c1a-49d3-9764-fdcc82069e51 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:57.506168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb6165-1c1a-49d3-9764-fdcc82069e51 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:57.506376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb6165-1c1a-49d3-9764-fdcc82069e51 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:57.514012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 271/541] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:28:57.514012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d840d5-96a3-4314-91a2-52f79f8304f5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:57.514012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d840d5-96a3-4314-91a2-52f79f8304f5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:57.514012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d840d5-96a3-4314-91a2-52f79f8304f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:57.518017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203a436-453e-4731-b740-43f659b5b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:57.519240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203a436-453e-4731-b740-43f659b5b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:57.519721 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203a436-453e-4731-b740-43f659b5b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:57.520202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203a436-453e-4731-b740-43f659b5b7b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:57.521237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203a436-453e-4731-b740-43f659b5b7b8 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=03e9f522282644e2aad2eefba7509f77) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:57.521740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203a436-453e-4731-b740-43f659b5b7b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:57.523402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203a436-453e-4731-b740-43f659b5b7b8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:57.529409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 271/542] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:28:57 2022] GET /identity/v3/role_assignments?user.id=03e9f522282644e2aad2eefba7509f77&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:57.535982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d0d840d5-96a3-4314-91a2-52f79f8304f5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:57.537270 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d0d840d5-96a3-4314-91a2-52f79f8304f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:57.621199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 272/543] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:57.675587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203a436-453e-4731-b740-43f659b5b7b8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:57.799397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203a436-453e-4731-b740-43f659b5b7b8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:57.836016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc2101-5e21-4d08-b136-69ec11829435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:57.837057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc2101-5e21-4d08-b136-69ec11829435 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:57.837481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc2101-5e21-4d08-b136-69ec11829435 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:57.837893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc2101-5e21-4d08-b136-69ec11829435 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:57.848686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc2101-5e21-4d08-b136-69ec11829435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b1cc2101-5e21-4d08-b136-69ec11829435 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:57.856570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:57.857631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:57.858657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:57.861529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 272/544] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:57.867201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d840d5-96a3-4314-91a2-52f79f8304f5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:58.059552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d840d5-96a3-4314-91a2-52f79f8304f5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:58.105408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debab86-da1a-4c1e-8ce3-ab87635cced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:58.106122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debab86-da1a-4c1e-8ce3-ab87635cced8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:58.106404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debab86-da1a-4c1e-8ce3-ab87635cced8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:58.106684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debab86-da1a-4c1e-8ce3-ab87635cced8 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:58.107430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debab86-da1a-4c1e-8ce3-ab87635cced8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:58.107741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debab86-da1a-4c1e-8ce3-ab87635cced8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:58.109373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debab86-da1a-4c1e-8ce3-ab87635cced8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:58.122110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 273/545] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:28:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:58.127046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc2101-5e21-4d08-b136-69ec11829435 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:58.253246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc2101-5e21-4d08-b136-69ec11829435 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:58.286593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8aee-26d7-4f3b-a8f9-1eace61aeb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:58.287709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8aee-26d7-4f3b-a8f9-1eace61aeb88 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:58.288207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8aee-26d7-4f3b-a8f9-1eace61aeb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:58.288675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8aee-26d7-4f3b-a8f9-1eace61aeb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:58.299877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8aee-26d7-4f3b-a8f9-1eace61aeb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:58.301554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8aee-26d7-4f3b-a8f9-1eace61aeb88 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1dce8aee-26d7-4f3b-a8f9-1eace61aeb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:58.318367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:58.319222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:58.320075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:58.320075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:58.320075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:58.320075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:58.322246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 273/546] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:58.330104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debab86-da1a-4c1e-8ce3-ab87635cced8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:58.500531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debab86-da1a-4c1e-8ce3-ab87635cced8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:58.548293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c84c0-eab9-4913-a8d7-e0884a489ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:58.549175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c84c0-eab9-4913-a8d7-e0884a489ede None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:58.549654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c84c0-eab9-4913-a8d7-e0884a489ede None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:58.550159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c84c0-eab9-4913-a8d7-e0884a489ede None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:58.551239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c84c0-eab9-4913-a8d7-e0884a489ede None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:58.551765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c84c0-eab9-4913-a8d7-e0884a489ede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:58.554020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c84c0-eab9-4913-a8d7-e0884a489ede None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:58.569054 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 274/547] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:58.574608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8aee-26d7-4f3b-a8f9-1eace61aeb88 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:58.709495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8aee-26d7-4f3b-a8f9-1eace61aeb88 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:58.754246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7e2fd-6f87-4f43-8faf-340b65d6388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:58.755084 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7e2fd-6f87-4f43-8faf-340b65d6388e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:58.755372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7e2fd-6f87-4f43-8faf-340b65d6388e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:58.755649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7e2fd-6f87-4f43-8faf-340b65d6388e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:58.765856 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7e2fd-6f87-4f43-8faf-340b65d6388e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:58.767349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7e2fd-6f87-4f43-8faf-340b65d6388e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d6c7e2fd-6f87-4f43-8faf-340b65d6388e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:28:58.784548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:58.785484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 15:28:58.786416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:58.790102 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 274/548] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:28:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:58.795130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c84c0-eab9-4913-a8d7-e0884a489ede None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:58.947333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c84c0-eab9-4913-a8d7-e0884a489ede None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:59.001148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5d714-3d4d-43e3-aafa-5f6458b0f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:59.002230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5d714-3d4d-43e3-aafa-5f6458b0f69c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.002714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5d714-3d4d-43e3-aafa-5f6458b0f69c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.003216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5d714-3d4d-43e3-aafa-5f6458b0f69c None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.004246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5d714-3d4d-43e3-aafa-5f6458b0f69c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:59.004748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5d714-3d4d-43e3-aafa-5f6458b0f69c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:59.006408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5d714-3d4d-43e3-aafa-5f6458b0f69c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:59.025768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 275/549] 10.222.0.75 () {56 vars in 1135 bytes} [Tue May 17 15:28:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:28:59.031834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7e2fd-6f87-4f43-8faf-340b65d6388e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:59.168762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7e2fd-6f87-4f43-8faf-340b65d6388e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:59.188633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e8885-6ed4-4c62-87e8-a6ef3ecf75b0 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.188931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e8885-6ed4-4c62-87e8-a6ef3ecf75b0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.189206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e8885-6ed4-4c62-87e8-a6ef3ecf75b0 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.191979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 276/550] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:59.196207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c0d46-d855-4ddc-b6cc-6f4fa51cfb81 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.196549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c0d46-d855-4ddc-b6cc-6f4fa51cfb81 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.196835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c0d46-d855-4ddc-b6cc-6f4fa51cfb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.214059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7d8c0d46-d855-4ddc-b6cc-6f4fa51cfb81 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:59.215170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7d8c0d46-d855-4ddc-b6cc-6f4fa51cfb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:59.224763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5467e9-ef99-40af-9d51-0b6f2a27dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:59.225411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5467e9-ef99-40af-9d51-0b6f2a27dd1a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.225688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5467e9-ef99-40af-9d51-0b6f2a27dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.225958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5467e9-ef99-40af-9d51-0b6f2a27dd1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.290107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 277/551] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:59.307305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c0d46-d855-4ddc-b6cc-6f4fa51cfb81 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:59.387271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5467e9-ef99-40af-9d51-0b6f2a27dd1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:59.388754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5467e9-ef99-40af-9d51-0b6f2a27dd1a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:59.415148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c0d46-d855-4ddc-b6cc-6f4fa51cfb81 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:59.449662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861483-0268-47cd-8cf1-e2f6f794a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:59.450506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861483-0268-47cd-8cf1-e2f6f794a886 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.450792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861483-0268-47cd-8cf1-e2f6f794a886 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.451068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861483-0268-47cd-8cf1-e2f6f794a886 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.461847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce861483-0268-47cd-8cf1-e2f6f794a886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ce861483-0268-47cd-8cf1-e2f6f794a886 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:28:59.470222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:59.471375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:28:59.472176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:59.476394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 278/552] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:59.477646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861483-0268-47cd-8cf1-e2f6f794a886 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:59.586878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861483-0268-47cd-8cf1-e2f6f794a886 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:59.591005 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 275/553] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:28:59.592168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dd556-61ee-4d03-bedd-2b403513dd4d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.592459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dd556-61ee-4d03-bedd-2b403513dd4d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.592740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dd556-61ee-4d03-bedd-2b403513dd4d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.599482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 276/554] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:59.600689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b2884-6b0e-47bc-9a45-8dc93997220b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.600977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b2884-6b0e-47bc-9a45-8dc93997220b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.601258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b2884-6b0e-47bc-9a45-8dc93997220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.619015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0d3b2884-6b0e-47bc-9a45-8dc93997220b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:59.620348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d3b2884-6b0e-47bc-9a45-8dc93997220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:59.626966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694e1eb-0a4e-4716-afca-a0ce97fc7312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:59.627874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694e1eb-0a4e-4716-afca-a0ce97fc7312 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.628005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694e1eb-0a4e-4716-afca-a0ce97fc7312 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.628179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694e1eb-0a4e-4716-afca-a0ce97fc7312 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.628972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694e1eb-0a4e-4716-afca-a0ce97fc7312 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:28:59.629277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694e1eb-0a4e-4716-afca-a0ce97fc7312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:59.630699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694e1eb-0a4e-4716-afca-a0ce97fc7312 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:59.640826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 279/555] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:28:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:28:59.642221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694e1eb-0a4e-4716-afca-a0ce97fc7312 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:59.697116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 277/556] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:28:59.697116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea241-d832-4d75-bcaa-244482f2b3ee None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.697116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea241-d832-4d75-bcaa-244482f2b3ee None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.697116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea241-d832-4d75-bcaa-244482f2b3ee None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.697116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 278/557] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:28:59.697116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea241-d832-4d75-bcaa-244482f2b3ee None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:59.745194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694e1eb-0a4e-4716-afca-a0ce97fc7312 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:59.780070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e6071-52c8-488a-bbfa-e7c9cdab6df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:59.781616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e6071-52c8-488a-bbfa-e7c9cdab6df7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.782144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e6071-52c8-488a-bbfa-e7c9cdab6df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.782986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e6071-52c8-488a-bbfa-e7c9cdab6df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.796309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e6071-52c8-488a-bbfa-e7c9cdab6df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:59.798540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e6071-52c8-488a-bbfa-e7c9cdab6df7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:59.807993 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea241-d832-4d75-bcaa-244482f2b3ee None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ec2e6071-52c8-488a-bbfa-e7c9cdab6df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:59.820795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:59.821637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:59.822536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:59.822536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:59.822536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:59.822536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:28:59.828789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 280/558] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:59.828789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ec1b5-928c-4389-94b9-e5932762b5df None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.828789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ec1b5-928c-4389-94b9-e5932762b5df None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.828789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ec1b5-928c-4389-94b9-e5932762b5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.842438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-608ec1b5-928c-4389-94b9-e5932762b5df None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:28:59.843621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-608ec1b5-928c-4389-94b9-e5932762b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:28:59.849846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455cfd0-193b-4846-8e3e-0c23028d3ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:28:59.850867 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455cfd0-193b-4846-8e3e-0c23028d3ffd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:28:59.851693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455cfd0-193b-4846-8e3e-0c23028d3ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:28:59.852117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455cfd0-193b-4846-8e3e-0c23028d3ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:28:59.865117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455cfd0-193b-4846-8e3e-0c23028d3ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:28:59.867664 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455cfd0-193b-4846-8e3e-0c23028d3ffd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4455cfd0-193b-4846-8e3e-0c23028d3ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:28:59.888001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:28:59.889007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:28:59.889913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:28:59.889913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:28:59.889913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:28:59.889913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:28:59.889913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 279/559] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:28:59.891936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455cfd0-193b-4846-8e3e-0c23028d3ffd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:28:59.915462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 281/560] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:28:59.916302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ec1b5-928c-4389-94b9-e5932762b5df None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.004571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455cfd0-193b-4846-8e3e-0c23028d3ffd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.009513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ec1b5-928c-4389-94b9-e5932762b5df None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.037758 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b339dc-4eea-4cb0-a1be-b53c542c4774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.038676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b339dc-4eea-4cb0-a1be-b53c542c4774 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.038943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b339dc-4eea-4cb0-a1be-b53c542c4774 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.039217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b339dc-4eea-4cb0-a1be-b53c542c4774 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.042745 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5fcb-b571-4a57-8154-2d40ec04d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.043402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5fcb-b571-4a57-8154-2d40ec04d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.043685 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5fcb-b571-4a57-8154-2d40ec04d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.043960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5fcb-b571-4a57-8154-2d40ec04d9e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.044674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e5fcb-b571-4a57-8154-2d40ec04d9e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:00.044978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e5fcb-b571-4a57-8154-2d40ec04d9e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.046890 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e5fcb-b571-4a57-8154-2d40ec04d9e3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.049495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b339dc-4eea-4cb0-a1be-b53c542c4774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-56b339dc-4eea-4cb0-a1be-b53c542c4774 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:00.057126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:00.058011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:00.059123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:00.059735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 282/561] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:00.059735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5fcb-b571-4a57-8154-2d40ec04d9e3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.063401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 280/562] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:00.064195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b339dc-4eea-4cb0-a1be-b53c542c4774 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.167332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b339dc-4eea-4cb0-a1be-b53c542c4774 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.169573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5fcb-b571-4a57-8154-2d40ec04d9e3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.199122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab012e3-e94c-4531-9a31-fb67f72cbb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.200038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab012e3-e94c-4531-9a31-fb67f72cbb22 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.200389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab012e3-e94c-4531-9a31-fb67f72cbb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.200724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab012e3-e94c-4531-9a31-fb67f72cbb22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.201498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4862c4-872d-4086-8501-0681bdd6e8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.202250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4862c4-872d-4086-8501-0681bdd6e8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.203146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4862c4-872d-4086-8501-0681bdd6e8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.203478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4862c4-872d-4086-8501-0681bdd6e8f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.204259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4862c4-872d-4086-8501-0681bdd6e8f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:00.204623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4862c4-872d-4086-8501-0681bdd6e8f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.206105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4862c4-872d-4086-8501-0681bdd6e8f0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.211890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab012e3-e94c-4531-9a31-fb67f72cbb22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:00.222400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 283/563] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:00.222400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4862c4-872d-4086-8501-0681bdd6e8f0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4ab012e3-e94c-4531-9a31-fb67f72cbb22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:00.222658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:00.224185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 281/564] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:00.225360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab012e3-e94c-4531-9a31-fb67f72cbb22 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.321025 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4862c4-872d-4086-8501-0681bdd6e8f0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.321716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab012e3-e94c-4531-9a31-fb67f72cbb22 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.353214 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714136b7-9f06-43c3-afc4-05771524736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.353390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528d9fb-95cf-4606-9113-4dba875950e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.354018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714136b7-9f06-43c3-afc4-05771524736c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.354136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528d9fb-95cf-4606-9113-4dba875950e3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.354313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528d9fb-95cf-4606-9113-4dba875950e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.354402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714136b7-9f06-43c3-afc4-05771524736c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.354582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714136b7-9f06-43c3-afc4-05771524736c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.354669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528d9fb-95cf-4606-9113-4dba875950e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.355311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528d9fb-95cf-4606-9113-4dba875950e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:00.355611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528d9fb-95cf-4606-9113-4dba875950e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.356973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528d9fb-95cf-4606-9113-4dba875950e3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.360951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714136b7-9f06-43c3-afc4-05771524736c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.362399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714136b7-9f06-43c3-afc4-05771524736c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.369346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 282/565] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:00.369346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528d9fb-95cf-4606-9113-4dba875950e3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-714136b7-9f06-43c3-afc4-05771524736c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:00.376375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:00.377399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 284/566] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:00.378788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714136b7-9f06-43c3-afc4-05771524736c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.469089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528d9fb-95cf-4606-9113-4dba875950e3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.472064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714136b7-9f06-43c3-afc4-05771524736c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.500891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284c805-0742-4f81-bd69-452384c1c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.501582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284c805-0742-4f81-bd69-452384c1c9dd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.501866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284c805-0742-4f81-bd69-452384c1c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.502169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284c805-0742-4f81-bd69-452384c1c9dd None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.502923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284c805-0742-4f81-bd69-452384c1c9dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:00.503229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284c805-0742-4f81-bd69-452384c1c9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.503392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f696c-af5e-4639-ad98-62434620a5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.504265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f696c-af5e-4639-ad98-62434620a5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.504551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f696c-af5e-4639-ad98-62434620a5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.504648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284c805-0742-4f81-bd69-452384c1c9dd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.504827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f696c-af5e-4639-ad98-62434620a5d6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.512065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f696c-af5e-4639-ad98-62434620a5d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.512198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 283/567] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:00.513292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a13bd-a2a3-407b-8303-549260e1254e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.513568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a13bd-a2a3-407b-8303-549260e1254e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.513664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f696c-af5e-4639-ad98-62434620a5d6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.513847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a13bd-a2a3-407b-8303-549260e1254e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.515799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 284/568] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:00.518815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a13bd-a2a3-407b-8303-549260e1254e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-cc3f696c-af5e-4639-ad98-62434620a5d6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:00.528823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:00.529840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 285/569] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:00.530826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f696c-af5e-4639-ad98-62434620a5d6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.620437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a13bd-a2a3-407b-8303-549260e1254e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.625629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f696c-af5e-4639-ad98-62434620a5d6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.652160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1b41e-c158-43aa-8ca2-6d67404884be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.652935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1b41e-c158-43aa-8ca2-6d67404884be None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.653216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1b41e-c158-43aa-8ca2-6d67404884be None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.653488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1b41e-c158-43aa-8ca2-6d67404884be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.656589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a15a6-df59-4a9d-8b4e-731b236760d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.657234 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a15a6-df59-4a9d-8b4e-731b236760d4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.657510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a15a6-df59-4a9d-8b4e-731b236760d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.657782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a15a6-df59-4a9d-8b4e-731b236760d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.658582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a15a6-df59-4a9d-8b4e-731b236760d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:00.658885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a15a6-df59-4a9d-8b4e-731b236760d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.660303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a15a6-df59-4a9d-8b4e-731b236760d4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.663418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1b41e-c158-43aa-8ca2-6d67404884be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.664828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1b41e-c158-43aa-8ca2-6d67404884be None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.671505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 286/570] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:00.672283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a15a6-df59-4a9d-8b4e-731b236760d4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6fb1b41e-c158-43aa-8ca2-6d67404884be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:00.681126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:00.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:00.683568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:00.683568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:00.683568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:00.683568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:00.683568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 285/571] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:00.683855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f753-9bd1-4ee5-8e43-93dab7dbeaec None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.684016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f753-9bd1-4ee5-8e43-93dab7dbeaec None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.684355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f753-9bd1-4ee5-8e43-93dab7dbeaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.700749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e014f753-9bd1-4ee5-8e43-93dab7dbeaec None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:00.701930 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e014f753-9bd1-4ee5-8e43-93dab7dbeaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:00.762945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 286/572] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:00.763733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014f753-9bd1-4ee5-8e43-93dab7dbeaec None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.769320 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a15a6-df59-4a9d-8b4e-731b236760d4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.802361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4455f-e32e-4ffe-a851-aaac13b96f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.803140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4455f-e32e-4ffe-a851-aaac13b96f10 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.803414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4455f-e32e-4ffe-a851-aaac13b96f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.803678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4455f-e32e-4ffe-a851-aaac13b96f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.813665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4455f-e32e-4ffe-a851-aaac13b96f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.815149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4455f-e32e-4ffe-a851-aaac13b96f10 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-07b4455f-e32e-4ffe-a851-aaac13b96f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:00.831959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:00.833014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:00.833943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:00.833943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:00.833943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:00.833943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:00.833943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 287/573] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:00.833943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4455f-e32e-4ffe-a851-aaac13b96f10 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.862704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014f753-9bd1-4ee5-8e43-93dab7dbeaec None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.894348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abebbff-37f4-4704-8553-504b98e19d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.894950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abebbff-37f4-4704-8553-504b98e19d27 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.895233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abebbff-37f4-4704-8553-504b98e19d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.895509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abebbff-37f4-4704-8553-504b98e19d27 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.896342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abebbff-37f4-4704-8553-504b98e19d27 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:00.896647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abebbff-37f4-4704-8553-504b98e19d27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.898128 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abebbff-37f4-4704-8553-504b98e19d27 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.914245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 287/574] 10.222.0.75 () {56 vars in 1137 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:00.915029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abebbff-37f4-4704-8553-504b98e19d27 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:00.926344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4455f-e32e-4ffe-a851-aaac13b96f10 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:00.958066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e7a4b-8b3c-4558-9d3a-0413380e29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:00.958702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e7a4b-8b3c-4558-9d3a-0413380e29af None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:00.958979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e7a4b-8b3c-4558-9d3a-0413380e29af None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:00.959245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e7a4b-8b3c-4558-9d3a-0413380e29af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:00.960057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e7a4b-8b3c-4558-9d3a-0413380e29af None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=db2c811cad8a490891834991a6101984) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:00.960362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e7a4b-8b3c-4558-9d3a-0413380e29af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:00.961781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e7a4b-8b3c-4558-9d3a-0413380e29af None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:00.966940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 288/575] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/role_assignments?user.id=db2c811cad8a490891834991a6101984&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:00.967685 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e7a4b-8b3c-4558-9d3a-0413380e29af None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.022608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abebbff-37f4-4704-8553-504b98e19d27 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.057848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852feb2-b3a7-4626-b0ce-43418de0137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.058554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852feb2-b3a7-4626-b0ce-43418de0137c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.058836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852feb2-b3a7-4626-b0ce-43418de0137c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.059116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852feb2-b3a7-4626-b0ce-43418de0137c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.059857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852feb2-b3a7-4626-b0ce-43418de0137c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:01.060164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852feb2-b3a7-4626-b0ce-43418de0137c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.061587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852feb2-b3a7-4626-b0ce-43418de0137c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.078754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 288/576] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:01.078754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852feb2-b3a7-4626-b0ce-43418de0137c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.087163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e7a4b-8b3c-4558-9d3a-0413380e29af None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.123958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfe781-e446-4e9a-86bf-86363014313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.125620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfe781-e446-4e9a-86bf-86363014313c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.125893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfe781-e446-4e9a-86bf-86363014313c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.126197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfe781-e446-4e9a-86bf-86363014313c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.137097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfe781-e446-4e9a-86bf-86363014313c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7adfe781-e446-4e9a-86bf-86363014313c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:01.144973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:01.146028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:01.146949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 289/577] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:01.147696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfe781-e446-4e9a-86bf-86363014313c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.187911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852feb2-b3a7-4626-b0ce-43418de0137c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.219746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7912865-9fba-4a75-8544-d825c052075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.220403 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7912865-9fba-4a75-8544-d825c052075b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.220677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7912865-9fba-4a75-8544-d825c052075b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.220944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7912865-9fba-4a75-8544-d825c052075b None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.221922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7912865-9fba-4a75-8544-d825c052075b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:01.222249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7912865-9fba-4a75-8544-d825c052075b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.223620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7912865-9fba-4a75-8544-d825c052075b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.240826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 289/578] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:01.241707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7912865-9fba-4a75-8544-d825c052075b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.252796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfe781-e446-4e9a-86bf-86363014313c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.286277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f83c63-e9e2-4133-af75-b82c302e577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.287070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f83c63-e9e2-4133-af75-b82c302e577f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.287361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f83c63-e9e2-4133-af75-b82c302e577f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.287620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f83c63-e9e2-4133-af75-b82c302e577f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.298610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f83c63-e9e2-4133-af75-b82c302e577f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.300351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f83c63-e9e2-4133-af75-b82c302e577f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a7f83c63-e9e2-4133-af75-b82c302e577f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:01.317521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:01.318524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:01.319428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:01.319428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:01.319428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:01.319428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:01.319428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 290/579] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:01.320225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f83c63-e9e2-4133-af75-b82c302e577f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.338828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7912865-9fba-4a75-8544-d825c052075b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.375184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99764db7-ef87-4ffe-86d0-139b797439bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.375963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99764db7-ef87-4ffe-86d0-139b797439bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.376239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99764db7-ef87-4ffe-86d0-139b797439bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.376515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99764db7-ef87-4ffe-86d0-139b797439bf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.383275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99764db7-ef87-4ffe-86d0-139b797439bf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.384698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99764db7-ef87-4ffe-86d0-139b797439bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-99764db7-ef87-4ffe-86d0-139b797439bf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:01.398859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:01.399807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 15:29:01.400762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:01.404567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 290/580] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:01.405147 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99764db7-ef87-4ffe-86d0-139b797439bf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.419481 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f83c63-e9e2-4133-af75-b82c302e577f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.455281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe1820-c858-4868-a9c3-6bdb0b79c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.456051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe1820-c858-4868-a9c3-6bdb0b79c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.456307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe1820-c858-4868-a9c3-6bdb0b79c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.456513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe1820-c858-4868-a9c3-6bdb0b79c1b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.457503 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe1820-c858-4868-a9c3-6bdb0b79c1b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:01.457650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe1820-c858-4868-a9c3-6bdb0b79c1b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.458963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe1820-c858-4868-a9c3-6bdb0b79c1b8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.467187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 291/581] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:01.470114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe1820-c858-4868-a9c3-6bdb0b79c1b8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.502029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99764db7-ef87-4ffe-86d0-139b797439bf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.534880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3ce28-9af7-41a7-be97-909294c6f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.535979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ce28-9af7-41a7-be97-909294c6f71f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.536263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ce28-9af7-41a7-be97-909294c6f71f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.536534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ce28-9af7-41a7-be97-909294c6f71f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.543417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3ce28-9af7-41a7-be97-909294c6f71f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.544836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3ce28-9af7-41a7-be97-909294c6f71f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b6c3ce28-9af7-41a7-be97-909294c6f71f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:01.559392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:01.560378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:01.561327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:01.563916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe1820-c858-4868-a9c3-6bdb0b79c1b8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.565239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 291/582] 10.222.0.75 () {56 vars in 1093 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:01.566072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3ce28-9af7-41a7-be97-909294c6f71f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.597185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72917326-4ba8-4f35-8824-eb63426c5f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.597942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72917326-4ba8-4f35-8824-eb63426c5f3b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.598244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72917326-4ba8-4f35-8824-eb63426c5f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.598531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72917326-4ba8-4f35-8824-eb63426c5f3b None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.599257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72917326-4ba8-4f35-8824-eb63426c5f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:01.599592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72917326-4ba8-4f35-8824-eb63426c5f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.601053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72917326-4ba8-4f35-8824-eb63426c5f3b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.613609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 292/583] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:01.615099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72917326-4ba8-4f35-8824-eb63426c5f3b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.665002 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3ce28-9af7-41a7-be97-909294c6f71f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.697199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977e027-5d37-4e7d-b08a-bd662156345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.697865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e027-5d37-4e7d-b08a-bd662156345c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.698174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e027-5d37-4e7d-b08a-bd662156345c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.698476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e027-5d37-4e7d-b08a-bd662156345c None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.699312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977e027-5d37-4e7d-b08a-bd662156345c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:01.699619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977e027-5d37-4e7d-b08a-bd662156345c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.701036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977e027-5d37-4e7d-b08a-bd662156345c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.710705 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72917326-4ba8-4f35-8824-eb63426c5f3b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.723104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 292/584] 10.222.0.75 () {56 vars in 1137 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:01.723104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977e027-5d37-4e7d-b08a-bd662156345c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.743924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50cf44-5f23-4574-a849-1325a9880805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.744721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50cf44-5f23-4574-a849-1325a9880805 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.745005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50cf44-5f23-4574-a849-1325a9880805 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.745282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50cf44-5f23-4574-a849-1325a9880805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.756127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50cf44-5f23-4574-a849-1325a9880805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.757581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50cf44-5f23-4574-a849-1325a9880805 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0b50cf44-5f23-4574-a849-1325a9880805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:01.775570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:01.776616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:01.777535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:01.777535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:01.777535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:01.777535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:01.777535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 293/585] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:01.778279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50cf44-5f23-4574-a849-1325a9880805 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.822025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977e027-5d37-4e7d-b08a-bd662156345c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.854852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6fcfd-5de0-4d62-90ad-e13debaa045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.855513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6fcfd-5de0-4d62-90ad-e13debaa045d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.855796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6fcfd-5de0-4d62-90ad-e13debaa045d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.856070 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6fcfd-5de0-4d62-90ad-e13debaa045d None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.857004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6fcfd-5de0-4d62-90ad-e13debaa045d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:01.857210 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6fcfd-5de0-4d62-90ad-e13debaa045d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.859195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6fcfd-5de0-4d62-90ad-e13debaa045d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.874287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50cf44-5f23-4574-a849-1325a9880805 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:01.876119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 293/586] 10.222.0.75 () {56 vars in 1133 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:01.876902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6fcfd-5de0-4d62-90ad-e13debaa045d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.909838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8487-9f0b-45fb-88e6-d82aafb12a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:01.910657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8487-9f0b-45fb-88e6-d82aafb12a81 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:01.910941 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8487-9f0b-45fb-88e6-d82aafb12a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:01.911216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8487-9f0b-45fb-88e6-d82aafb12a81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:01.917828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e8487-9f0b-45fb-88e6-d82aafb12a81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:01.919308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e8487-9f0b-45fb-88e6-d82aafb12a81 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-875e8487-9f0b-45fb-88e6-d82aafb12a81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:01.933425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:01.934377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 294/587] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:01.940793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8487-9f0b-45fb-88e6-d82aafb12a81 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:01.973590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6fcfd-5de0-4d62-90ad-e13debaa045d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.006174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02444a3-3283-4b69-8553-7023577643b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.006956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02444a3-3283-4b69-8553-7023577643b3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.007237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02444a3-3283-4b69-8553-7023577643b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.007508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02444a3-3283-4b69-8553-7023577643b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.017324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02444a3-3283-4b69-8553-7023577643b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.018806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02444a3-3283-4b69-8553-7023577643b3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.034596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8487-9f0b-45fb-88e6-d82aafb12a81 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d02444a3-3283-4b69-8553-7023577643b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:02.036211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:02.037130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:02.038465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:02.038465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:02.038465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:02.038465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:02.038465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 294/588] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:02.038465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02444a3-3283-4b69-8553-7023577643b3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.073301 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828ac3-c73b-4ad5-9dca-3ddec93a9d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.073974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828ac3-c73b-4ad5-9dca-3ddec93a9d7b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.074285 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828ac3-c73b-4ad5-9dca-3ddec93a9d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.074589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828ac3-c73b-4ad5-9dca-3ddec93a9d7b None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.075284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828ac3-c73b-4ad5-9dca-3ddec93a9d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:02.075597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828ac3-c73b-4ad5-9dca-3ddec93a9d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.076972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828ac3-c73b-4ad5-9dca-3ddec93a9d7b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.088745 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 295/589] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:02.089867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828ac3-c73b-4ad5-9dca-3ddec93a9d7b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.138719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02444a3-3283-4b69-8553-7023577643b3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.173229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a93121-4a95-4ecf-af64-29824bd1d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.173941 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93121-4a95-4ecf-af64-29824bd1d09b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.174253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93121-4a95-4ecf-af64-29824bd1d09b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.174526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93121-4a95-4ecf-af64-29824bd1d09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.184640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a93121-4a95-4ecf-af64-29824bd1d09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.186107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a93121-4a95-4ecf-af64-29824bd1d09b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.187485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828ac3-c73b-4ad5-9dca-3ddec93a9d7b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b1a93121-4a95-4ecf-af64-29824bd1d09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:02.204517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:02.205441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:02.206392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:02.206392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:02.206392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:02.206392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:02.210360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 295/590] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:02.211176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a93121-4a95-4ecf-af64-29824bd1d09b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.222283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393134ce-b20a-4bdb-b7a9-7387b59f2c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.222944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393134ce-b20a-4bdb-b7a9-7387b59f2c83 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.223227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393134ce-b20a-4bdb-b7a9-7387b59f2c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.223501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393134ce-b20a-4bdb-b7a9-7387b59f2c83 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.224282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393134ce-b20a-4bdb-b7a9-7387b59f2c83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:02.224590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393134ce-b20a-4bdb-b7a9-7387b59f2c83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.226035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393134ce-b20a-4bdb-b7a9-7387b59f2c83 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.242493 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 296/591] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:02.242493 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393134ce-b20a-4bdb-b7a9-7387b59f2c83 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.307378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a93121-4a95-4ecf-af64-29824bd1d09b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.341296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663180b-b1d9-4ee2-96f2-7cfad97bd9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.341952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663180b-b1d9-4ee2-96f2-7cfad97bd9ca None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.342280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663180b-b1d9-4ee2-96f2-7cfad97bd9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.342556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663180b-b1d9-4ee2-96f2-7cfad97bd9ca None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.343841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663180b-b1d9-4ee2-96f2-7cfad97bd9ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:02.343942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393134ce-b20a-4bdb-b7a9-7387b59f2c83 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.344147 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663180b-b1d9-4ee2-96f2-7cfad97bd9ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.345510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663180b-b1d9-4ee2-96f2-7cfad97bd9ca None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.356562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 296/592] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:02.357532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663180b-b1d9-4ee2-96f2-7cfad97bd9ca None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.376865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237f471-9d37-494c-83eb-2f57d99b7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.377656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237f471-9d37-494c-83eb-2f57d99b7762 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.377938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237f471-9d37-494c-83eb-2f57d99b7762 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.378240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237f471-9d37-494c-83eb-2f57d99b7762 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.385487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237f471-9d37-494c-83eb-2f57d99b7762 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.386953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237f471-9d37-494c-83eb-2f57d99b7762 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1237f471-9d37-494c-83eb-2f57d99b7762 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:02.401225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:02.402544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:02.403472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 297/593] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:02.404069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237f471-9d37-494c-83eb-2f57d99b7762 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.457278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663180b-b1d9-4ee2-96f2-7cfad97bd9ca None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.497703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a71908-94c8-4c90-86e5-58b964b50aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.498489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a71908-94c8-4c90-86e5-58b964b50aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.498778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a71908-94c8-4c90-86e5-58b964b50aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.499052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a71908-94c8-4c90-86e5-58b964b50aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.499862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a71908-94c8-4c90-86e5-58b964b50aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:02.500166 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a71908-94c8-4c90-86e5-58b964b50aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.501574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a71908-94c8-4c90-86e5-58b964b50aa6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.502400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237f471-9d37-494c-83eb-2f57d99b7762 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.514057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 297/594] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:02.515518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a71908-94c8-4c90-86e5-58b964b50aa6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.537838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca5896-74d2-4774-a12b-22111651e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.538816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca5896-74d2-4774-a12b-22111651e134 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.539090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca5896-74d2-4774-a12b-22111651e134 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.539364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca5896-74d2-4774-a12b-22111651e134 None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/22c0e889e1f842b2a6081f38aabd97ac/roles/d07b4b63f6254b2da86b74c94166cb68` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.553479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca5896-74d2-4774-a12b-22111651e134 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=22c0e889e1f842b2a6081f38aabd97ac, role_id=d07b4b63f6254b2da86b74c94166cb68)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.554993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca5896-74d2-4774-a12b-22111651e134 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.569778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 298/595] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:29:02 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/22c0e889e1f842b2a6081f38aabd97ac/roles/d07b4b63f6254b2da86b74c94166cb68 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:29:02.570977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca5896-74d2-4774-a12b-22111651e134 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.622742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a71908-94c8-4c90-86e5-58b964b50aa6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.660136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec6bb-49c7-441e-8849-563e13307753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.660896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec6bb-49c7-441e-8849-563e13307753 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.661177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec6bb-49c7-441e-8849-563e13307753 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.661443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec6bb-49c7-441e-8849-563e13307753 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.668984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ec6bb-49c7-441e-8849-563e13307753 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.670482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ec6bb-49c7-441e-8849-563e13307753 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.684690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca5896-74d2-4774-a12b-22111651e134 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f39ec6bb-49c7-441e-8849-563e13307753 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:02.685004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:02.685859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:02.687894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:02.687894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:02.687894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:02.687894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:02.687894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:02.687894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:02.687894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:02.687894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:02.687894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 298/596] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:02.688414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec6bb-49c7-441e-8849-563e13307753 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.726674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec33cb-477d-4b33-a170-26e1a1767e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.728057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec33cb-477d-4b33-a170-26e1a1767e4b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.728577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec33cb-477d-4b33-a170-26e1a1767e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.729058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec33cb-477d-4b33-a170-26e1a1767e4b None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.730178 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec33cb-477d-4b33-a170-26e1a1767e4b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:02.730710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec33cb-477d-4b33-a170-26e1a1767e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.732386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec33cb-477d-4b33-a170-26e1a1767e4b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.752390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 299/597] 10.222.0.75 () {56 vars in 1139 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:02.753674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec33cb-477d-4b33-a170-26e1a1767e4b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.805678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec6bb-49c7-441e-8849-563e13307753 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.843901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0320-9beb-43bf-ac3b-a29b5ea7d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.845101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0320-9beb-43bf-ac3b-a29b5ea7d58a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.845588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0320-9beb-43bf-ac3b-a29b5ea7d58a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.846349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0320-9beb-43bf-ac3b-a29b5ea7d58a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.858125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd0320-9beb-43bf-ac3b-a29b5ea7d58a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.860488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd0320-9beb-43bf-ac3b-a29b5ea7d58a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.861516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec33cb-477d-4b33-a170-26e1a1767e4b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-43fd0320-9beb-43bf-ac3b-a29b5ea7d58a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:02.879369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:02.880324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:02.881198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:02.881198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:02.881198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:02.881198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:02.881198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:02.881198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:02.881198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:02.881198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:02.883785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 299/598] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:02.884950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0320-9beb-43bf-ac3b-a29b5ea7d58a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.903158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df81624-88c9-499d-9cdd-4aa8a8dcc570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:02.903991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df81624-88c9-499d-9cdd-4aa8a8dcc570 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:02.904128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df81624-88c9-499d-9cdd-4aa8a8dcc570 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:02.904451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df81624-88c9-499d-9cdd-4aa8a8dcc570 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:02.905292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df81624-88c9-499d-9cdd-4aa8a8dcc570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:02.906150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df81624-88c9-499d-9cdd-4aa8a8dcc570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:02.907579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df81624-88c9-499d-9cdd-4aa8a8dcc570 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:02.919571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 300/599] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:02.920521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df81624-88c9-499d-9cdd-4aa8a8dcc570 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:02.989281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0320-9beb-43bf-ac3b-a29b5ea7d58a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.021707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df81624-88c9-499d-9cdd-4aa8a8dcc570 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.023813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040ee1e-675d-4afb-aa86-1c8551e707bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.024852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040ee1e-675d-4afb-aa86-1c8551e707bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.025355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040ee1e-675d-4afb-aa86-1c8551e707bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.025828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040ee1e-675d-4afb-aa86-1c8551e707bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.036977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040ee1e-675d-4afb-aa86-1c8551e707bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:03.038747 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040ee1e-675d-4afb-aa86-1c8551e707bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:03.057180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c991686-786e-45ac-97b6-dbe5dabfeccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.057898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c991686-786e-45ac-97b6-dbe5dabfeccf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.058216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c991686-786e-45ac-97b6-dbe5dabfeccf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1040ee1e-675d-4afb-aa86-1c8551e707bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:03.058427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:03.059255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:03.060150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:03.060150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:03.060150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:03.060150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:03.060369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c991686-786e-45ac-97b6-dbe5dabfeccf None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.060369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c991686-786e-45ac-97b6-dbe5dabfeccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:03.060369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c991686-786e-45ac-97b6-dbe5dabfeccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:03.061093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c991686-786e-45ac-97b6-dbe5dabfeccf None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:03.063061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 300/600] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:03.064239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040ee1e-675d-4afb-aa86-1c8551e707bf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:03.080211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 301/601] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:03.081250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c991686-786e-45ac-97b6-dbe5dabfeccf None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:03.174805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040ee1e-675d-4afb-aa86-1c8551e707bf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.181065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c991686-786e-45ac-97b6-dbe5dabfeccf None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.209921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc6428-d0c2-41e1-9bab-d50b9673ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.211237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc6428-d0c2-41e1-9bab-d50b9673ce2b None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.211726 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc6428-d0c2-41e1-9bab-d50b9673ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.212195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc6428-d0c2-41e1-9bab-d50b9673ce2b None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/3196743ff7564c16b3cfdae4f0008075/roles/d07b4b63f6254b2da86b74c94166cb68` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.216323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a0ae3-9812-4ae1-8e53-a1965f4f2ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.216566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a0ae3-9812-4ae1-8e53-a1965f4f2ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.216756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a0ae3-9812-4ae1-8e53-a1965f4f2ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.217009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a0ae3-9812-4ae1-8e53-a1965f4f2ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.217792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a0ae3-9812-4ae1-8e53-a1965f4f2ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:03.218716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a0ae3-9812-4ae1-8e53-a1965f4f2ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:03.220088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a0ae3-9812-4ae1-8e53-a1965f4f2ee4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:03.229976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc6428-d0c2-41e1-9bab-d50b9673ce2b None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=3196743ff7564c16b3cfdae4f0008075, role_id=d07b4b63f6254b2da86b74c94166cb68)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:03.232922 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 302/602] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:03.233547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a0ae3-9812-4ae1-8e53-a1965f4f2ee4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:03.235304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc6428-d0c2-41e1-9bab-d50b9673ce2b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:03.252067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 301/603] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:29:03 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/3196743ff7564c16b3cfdae4f0008075/roles/d07b4b63f6254b2da86b74c94166cb68 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:29:03.253601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc6428-d0c2-41e1-9bab-d50b9673ce2b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:03.376841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a0ae3-9812-4ae1-8e53-a1965f4f2ee4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.387109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc6428-d0c2-41e1-9bab-d50b9673ce2b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.422388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd19dc-e26a-4dbd-b670-9c0ad7db2992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.423300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd19dc-e26a-4dbd-b670-9c0ad7db2992 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.423577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd19dc-e26a-4dbd-b670-9c0ad7db2992 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.423850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd19dc-e26a-4dbd-b670-9c0ad7db2992 None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8ef90c1c9c784d8792b3afe6e8e7fb31/roles/d07b4b63f6254b2da86b74c94166cb68` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.424931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26d708-1bf3-448b-bb44-d67c862fb274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.425733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26d708-1bf3-448b-bb44-d67c862fb274 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.426030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26d708-1bf3-448b-bb44-d67c862fb274 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.426307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26d708-1bf3-448b-bb44-d67c862fb274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.434538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26d708-1bf3-448b-bb44-d67c862fb274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:03.436037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26d708-1bf3-448b-bb44-d67c862fb274 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:03.442966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd19dc-e26a-4dbd-b670-9c0ad7db2992 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=8ef90c1c9c784d8792b3afe6e8e7fb31, role_id=d07b4b63f6254b2da86b74c94166cb68)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:03.444734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd19dc-e26a-4dbd-b670-9c0ad7db2992 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-bd26d708-1bf3-448b-bb44-d67c862fb274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:03.451290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:03.453014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:03.454155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:03.454155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:03.454155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:03.454155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:03.454155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:03.454155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:03.454155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:03.454155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:03.454155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 302/604] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:03.454883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc00bca-f9fe-4a24-9e5c-15224cd2bb52 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.455125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc00bca-f9fe-4a24-9e5c-15224cd2bb52 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.455579 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc00bca-f9fe-4a24-9e5c-15224cd2bb52 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.457110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 303/605] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:03.463449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62065f1b-8ecd-4d58-9c4a-7ea6697781b9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.463785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62065f1b-8ecd-4d58-9c4a-7ea6697781b9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.464066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62065f1b-8ecd-4d58-9c4a-7ea6697781b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.468637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 303/606] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:29:03 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8ef90c1c9c784d8792b3afe6e8e7fb31/roles/d07b4b63f6254b2da86b74c94166cb68 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:29:03.469326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd19dc-e26a-4dbd-b670-9c0ad7db2992 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:03.487135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-62065f1b-8ecd-4d58-9c4a-7ea6697781b9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:03.489294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-62065f1b-8ecd-4d58-9c4a-7ea6697781b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:03.572617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 304/607] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:03.587779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd19dc-e26a-4dbd-b670-9c0ad7db2992 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.597349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62065f1b-8ecd-4d58-9c4a-7ea6697781b9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:03.637952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869029-d02f-4194-90b2-287dea98d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.638654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869029-d02f-4194-90b2-287dea98d9df None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.638989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869029-d02f-4194-90b2-287dea98d9df None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.639272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869029-d02f-4194-90b2-287dea98d9df None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.640107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869029-d02f-4194-90b2-287dea98d9df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:03.640415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869029-d02f-4194-90b2-287dea98d9df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:03.641868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869029-d02f-4194-90b2-287dea98d9df None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:03.654772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 304/608] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:03.663299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869029-d02f-4194-90b2-287dea98d9df None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:03.705744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62065f1b-8ecd-4d58-9c4a-7ea6697781b9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.742396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e4ab2-398b-425d-bbd6-a9ffe9345ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.743517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e4ab2-398b-425d-bbd6-a9ffe9345ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.744036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e4ab2-398b-425d-bbd6-a9ffe9345ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.744496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e4ab2-398b-425d-bbd6-a9ffe9345ea7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.757053 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e4ab2-398b-425d-bbd6-a9ffe9345ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-097e4ab2-398b-425d-bbd6-a9ffe9345ea7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:03.765516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:03.766503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:03.767344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:03.775048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 305/609] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:03.776164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e4ab2-398b-425d-bbd6-a9ffe9345ea7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:03.801250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869029-d02f-4194-90b2-287dea98d9df None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.863819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22174f-9ba8-474c-9889-45dae588efb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.864709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22174f-9ba8-474c-9889-45dae588efb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.864984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22174f-9ba8-474c-9889-45dae588efb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.865254 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22174f-9ba8-474c-9889-45dae588efb1 None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/03e9f522282644e2aad2eefba7509f77/roles/d07b4b63f6254b2da86b74c94166cb68` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.896052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22174f-9ba8-474c-9889-45dae588efb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=03e9f522282644e2aad2eefba7509f77, role_id=d07b4b63f6254b2da86b74c94166cb68)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:03.897501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22174f-9ba8-474c-9889-45dae588efb1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:03.919042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 305/610] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:29:03 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/03e9f522282644e2aad2eefba7509f77/roles/d07b4b63f6254b2da86b74c94166cb68 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:29:03.930331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e4ab2-398b-425d-bbd6-a9ffe9345ea7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:03.970829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384d03f-0ffe-4a01-961b-76c113b5ea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:03.971779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384d03f-0ffe-4a01-961b-76c113b5ea63 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:03.972061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384d03f-0ffe-4a01-961b-76c113b5ea63 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:03.972334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384d03f-0ffe-4a01-961b-76c113b5ea63 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:03.973121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384d03f-0ffe-4a01-961b-76c113b5ea63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:03.973426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384d03f-0ffe-4a01-961b-76c113b5ea63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:03.974910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384d03f-0ffe-4a01-961b-76c113b5ea63 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:03.984614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 306/611] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:03.990036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22174f-9ba8-474c-9889-45dae588efb1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:04.126850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22174f-9ba8-474c-9889-45dae588efb1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:04.160295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae68425-fea0-46f3-851f-1540ccca32ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:04.161085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae68425-fea0-46f3-851f-1540ccca32ee None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:04.161359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae68425-fea0-46f3-851f-1540ccca32ee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:04.161672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae68425-fea0-46f3-851f-1540ccca32ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:04.172167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae68425-fea0-46f3-851f-1540ccca32ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:04.173602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae68425-fea0-46f3-851f-1540ccca32ee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-bae68425-fea0-46f3-851f-1540ccca32ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:04.191518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:04.192444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:04.194152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:04.194152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:04.194152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:04.194152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:04.194152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 306/612] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:04.198490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384d03f-0ffe-4a01-961b-76c113b5ea63 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:04.309589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384d03f-0ffe-4a01-961b-76c113b5ea63 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:04.355635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a64c7-764a-40fb-996c-8e597a776997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:04.356297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a64c7-764a-40fb-996c-8e597a776997 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:04.356576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a64c7-764a-40fb-996c-8e597a776997 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:04.356848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a64c7-764a-40fb-996c-8e597a776997 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:04.357572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a64c7-764a-40fb-996c-8e597a776997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:04.357869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a64c7-764a-40fb-996c-8e597a776997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:04.359798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a64c7-764a-40fb-996c-8e597a776997 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:04.374808 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 307/613] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:04.380193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae68425-fea0-46f3-851f-1540ccca32ee None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:04.492904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae68425-fea0-46f3-851f-1540ccca32ee None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:04.526238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b93ef-12db-4960-9fd6-42040ebdedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:04.527032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b93ef-12db-4960-9fd6-42040ebdedd1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:04.527306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b93ef-12db-4960-9fd6-42040ebdedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:04.527564 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b93ef-12db-4960-9fd6-42040ebdedd1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:04.535455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b93ef-12db-4960-9fd6-42040ebdedd1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:04.536888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b93ef-12db-4960-9fd6-42040ebdedd1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-712b93ef-12db-4960-9fd6-42040ebdedd1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:04.551775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:04.554013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:04.556335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 307/614] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:04.559532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a64c7-764a-40fb-996c-8e597a776997 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:04.681400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a64c7-764a-40fb-996c-8e597a776997 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:04.715023 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7efd7-103f-4700-acde-5fc8749bb2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:04.715805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7efd7-103f-4700-acde-5fc8749bb2eb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:04.715968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7efd7-103f-4700-acde-5fc8749bb2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:04.716201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7efd7-103f-4700-acde-5fc8749bb2eb None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:04.717033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7efd7-103f-4700-acde-5fc8749bb2eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:04.717334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7efd7-103f-4700-acde-5fc8749bb2eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:04.719319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7efd7-103f-4700-acde-5fc8749bb2eb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:04.743899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 308/615] 10.222.0.75 () {56 vars in 1135 bytes} [Tue May 17 15:29:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:04.749443 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b93ef-12db-4960-9fd6-42040ebdedd1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:04.850191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b93ef-12db-4960-9fd6-42040ebdedd1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:04.883944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723229-43d9-4286-b6cc-002f25987f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:04.884730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723229-43d9-4286-b6cc-002f25987f7a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:04.885006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723229-43d9-4286-b6cc-002f25987f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:04.885277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723229-43d9-4286-b6cc-002f25987f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:04.895726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00723229-43d9-4286-b6cc-002f25987f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:04.897185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00723229-43d9-4286-b6cc-002f25987f7a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-00723229-43d9-4286-b6cc-002f25987f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:04.914706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:04.916805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:04.918998 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:04.918998 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:04.918998 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:04.918998 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:04.918998 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 308/616] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:04.923269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7efd7-103f-4700-acde-5fc8749bb2eb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:05.056961 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7efd7-103f-4700-acde-5fc8749bb2eb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:05.097698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61b074-e691-46d6-aa80-d93444eb1e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:05.098391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b074-e691-46d6-aa80-d93444eb1e3f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:05.098678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b074-e691-46d6-aa80-d93444eb1e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:05.098954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b074-e691-46d6-aa80-d93444eb1e3f None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:05.099679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b074-e691-46d6-aa80-d93444eb1e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:05.099984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b074-e691-46d6-aa80-d93444eb1e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:05.101355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b074-e691-46d6-aa80-d93444eb1e3f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:05.113368 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 309/617] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:05.118998 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723229-43d9-4286-b6cc-002f25987f7a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:05.229727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723229-43d9-4286-b6cc-002f25987f7a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:05.235700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc87e67-5803-4b26-8f66-e1f477a7930b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:05.236016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc87e67-5803-4b26-8f66-e1f477a7930b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:05.236249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc87e67-5803-4b26-8f66-e1f477a7930b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:05.237892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 310/618] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:05.247509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5659d-134b-4a61-b301-4d1bd1e5a10e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:05.247805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5659d-134b-4a61-b301-4d1bd1e5a10e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:05.248065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5659d-134b-4a61-b301-4d1bd1e5a10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:05.265869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d1265-8312-4443-ba93-7a2638a255cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:05.266699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d1265-8312-4443-ba93-7a2638a255cc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:05.266979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d1265-8312-4443-ba93-7a2638a255cc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:05.267250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d1265-8312-4443-ba93-7a2638a255cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:05.274620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d1265-8312-4443-ba93-7a2638a255cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:05.276182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d1265-8312-4443-ba93-7a2638a255cc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:05.288261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cce5659d-134b-4a61-b301-4d1bd1e5a10e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:05.289468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cce5659d-134b-4a61-b301-4d1bd1e5a10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-cd9d1265-8312-4443-ba93-7a2638a255cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:05.291195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:05.293222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:05.295424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:05.295424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:05.295424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:05.295424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:05.295424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:05.295424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:05.295424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:05.295424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:05.295424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 309/619] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:05.303113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d1265-8312-4443-ba93-7a2638a255cc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:05.426365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d1265-8312-4443-ba93-7a2638a255cc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:05.444536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 311/620] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:05.465480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65cae-8593-4b83-8bab-a863040a7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:05.466165 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65cae-8593-4b83-8bab-a863040a7c53 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:05.466446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65cae-8593-4b83-8bab-a863040a7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:05.466714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65cae-8593-4b83-8bab-a863040a7c53 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:05.467494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e65cae-8593-4b83-8bab-a863040a7c53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:05.468418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e65cae-8593-4b83-8bab-a863040a7c53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:05.469865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e65cae-8593-4b83-8bab-a863040a7c53 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:05.482933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 310/621] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:05.488731 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5659d-134b-4a61-b301-4d1bd1e5a10e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:05.495083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65cae-8593-4b83-8bab-a863040a7c53 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:05.652443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5659d-134b-4a61-b301-4d1bd1e5a10e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:05.667806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65cae-8593-4b83-8bab-a863040a7c53 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:05.713624 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d2a0c-aa4a-4ccc-b768-b9963f5afb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:05.715588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d2a0c-aa4a-4ccc-b768-b9963f5afb26 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:05.717909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d2a0c-aa4a-4ccc-b768-b9963f5afb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:05.718424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d2a0c-aa4a-4ccc-b768-b9963f5afb26 None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/db2c811cad8a490891834991a6101984/roles/d07b4b63f6254b2da86b74c94166cb68` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:05.731624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d9b54-d90c-4fef-aec7-27ed7d25d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:05.732742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d9b54-d90c-4fef-aec7-27ed7d25d100 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:05.733230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d9b54-d90c-4fef-aec7-27ed7d25d100 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:05.733757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d9b54-d90c-4fef-aec7-27ed7d25d100 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:05.746869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d2a0c-aa4a-4ccc-b768-b9963f5afb26 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=db2c811cad8a490891834991a6101984, role_id=d07b4b63f6254b2da86b74c94166cb68)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:05.750056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d2a0c-aa4a-4ccc-b768-b9963f5afb26 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:05.755071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d9b54-d90c-4fef-aec7-27ed7d25d100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-070d9b54-d90c-4fef-aec7-27ed7d25d100 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:05.762995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:05.763917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:05.765326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:05.773897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 311/622] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:05.775371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d9b54-d90c-4fef-aec7-27ed7d25d100 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:05.799960 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 312/623] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:29:05 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/db2c811cad8a490891834991a6101984/roles/d07b4b63f6254b2da86b74c94166cb68 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:29:05.890902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d9b54-d90c-4fef-aec7-27ed7d25d100 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:05.927809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2187e8-bdbe-4f21-97d6-0f1c0820230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:05.928816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2187e8-bdbe-4f21-97d6-0f1c0820230c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:05.929283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2187e8-bdbe-4f21-97d6-0f1c0820230c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:05.929737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2187e8-bdbe-4f21-97d6-0f1c0820230c None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:05.930689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2187e8-bdbe-4f21-97d6-0f1c0820230c None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:05.931197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2187e8-bdbe-4f21-97d6-0f1c0820230c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:05.932755 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2187e8-bdbe-4f21-97d6-0f1c0820230c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:05.946100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 312/624] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:05.947727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d2a0c-aa4a-4ccc-b768-b9963f5afb26 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:06.086169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d2a0c-aa4a-4ccc-b768-b9963f5afb26 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:06.129665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d38e-e1b6-469b-b37b-ad03f4c389b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:06.130533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d38e-e1b6-469b-b37b-ad03f4c389b5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.130815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d38e-e1b6-469b-b37b-ad03f4c389b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.131089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d38e-e1b6-469b-b37b-ad03f4c389b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.143380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7d38e-e1b6-469b-b37b-ad03f4c389b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:06.143380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7d38e-e1b6-469b-b37b-ad03f4c389b5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c8c7d38e-e1b6-469b-b37b-ad03f4c389b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:06.168895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:06.169844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:06.170765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:06.170765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:06.170765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:06.170765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:06.173788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 313/625] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:06.178549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2187e8-bdbe-4f21-97d6-0f1c0820230c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:06.224884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4ec81-79c1-4434-96dd-f4ac036453b3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.225405 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4ec81-79c1-4434-96dd-f4ac036453b3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.225846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4ec81-79c1-4434-96dd-f4ac036453b3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.227382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 314/626] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:06.232592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae306a-ddba-442a-8435-589197ea1bf2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.233089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae306a-ddba-442a-8435-589197ea1bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.233566 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae306a-ddba-442a-8435-589197ea1bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.266518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c2ae306a-ddba-442a-8435-589197ea1bf2 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:06.267711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c2ae306a-ddba-442a-8435-589197ea1bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:06.293627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2187e8-bdbe-4f21-97d6-0f1c0820230c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:06.327649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850bf37-9c84-480e-8a57-83834dbe928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:06.328588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850bf37-9c84-480e-8a57-83834dbe928f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.329022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850bf37-9c84-480e-8a57-83834dbe928f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.329462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850bf37-9c84-480e-8a57-83834dbe928f None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.330363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850bf37-9c84-480e-8a57-83834dbe928f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:06.330811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850bf37-9c84-480e-8a57-83834dbe928f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:06.332321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850bf37-9c84-480e-8a57-83834dbe928f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:06.350122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 313/627] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:06.351560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850bf37-9c84-480e-8a57-83834dbe928f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:06.440713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 315/628] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 17 15:29:06.459089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850bf37-9c84-480e-8a57-83834dbe928f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:06.477336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae306a-ddba-442a-8435-589197ea1bf2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:06.494586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3665a-4313-433a-95f3-f029d16d1a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:06.495650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3665a-4313-433a-95f3-f029d16d1a66 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.496080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3665a-4313-433a-95f3-f029d16d1a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.496498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3665a-4313-433a-95f3-f029d16d1a66 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.504578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3665a-4313-433a-95f3-f029d16d1a66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:06.506235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3665a-4313-433a-95f3-f029d16d1a66 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-11d3665a-4313-433a-95f3-f029d16d1a66 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:06.521709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:06.522917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 15:29:06.524078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:06.530371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 314/629] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:06.531874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3665a-4313-433a-95f3-f029d16d1a66 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:06.613564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae306a-ddba-442a-8435-589197ea1bf2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:06.651364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f601b0-b5c6-4733-9a43-498db56d0fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:06.652168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f601b0-b5c6-4733-9a43-498db56d0fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.652450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f601b0-b5c6-4733-9a43-498db56d0fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.652724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f601b0-b5c6-4733-9a43-498db56d0fc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.668896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f601b0-b5c6-4733-9a43-498db56d0fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f6f601b0-b5c6-4733-9a43-498db56d0fc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:06.679942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:06.680906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:06.682293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:06.683314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3665a-4313-433a-95f3-f029d16d1a66 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:06.683431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 316/630] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:06.683431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b159f-e63f-4a29-8e32-e43dcf2bf876 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.683431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b159f-e63f-4a29-8e32-e43dcf2bf876 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.683431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b159f-e63f-4a29-8e32-e43dcf2bf876 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.685799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 317/631] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:06.687867 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b159f-e63f-4a29-8e32-e43dcf2bf876 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:06.724388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ded19-e542-4e3e-a99c-959d9e247532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:06.725057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ded19-e542-4e3e-a99c-959d9e247532 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.725340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ded19-e542-4e3e-a99c-959d9e247532 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.725614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ded19-e542-4e3e-a99c-959d9e247532 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.726480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ded19-e542-4e3e-a99c-959d9e247532 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:06.726790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ded19-e542-4e3e-a99c-959d9e247532 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:06.728235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ded19-e542-4e3e-a99c-959d9e247532 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:06.747173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 315/632] 10.222.0.75 () {56 vars in 1137 bytes} [Tue May 17 15:29:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:06.749562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df08507-4e93-4f1b-86a2-f235e938e060 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.749846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df08507-4e93-4f1b-86a2-f235e938e060 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.750146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df08507-4e93-4f1b-86a2-f235e938e060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.768488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3df08507-4e93-4f1b-86a2-f235e938e060 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:06.769947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3df08507-4e93-4f1b-86a2-f235e938e060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:06.789225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b159f-e63f-4a29-8e32-e43dcf2bf876 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:06.821754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23bcb8-5cea-4deb-9042-02450d49da76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:06.822713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23bcb8-5cea-4deb-9042-02450d49da76 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.822998 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23bcb8-5cea-4deb-9042-02450d49da76 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.823271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23bcb8-5cea-4deb-9042-02450d49da76 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.824018 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23bcb8-5cea-4deb-9042-02450d49da76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:06.824361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23bcb8-5cea-4deb-9042-02450d49da76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:06.825756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23bcb8-5cea-4deb-9042-02450d49da76 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:06.833745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 318/633] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:06.846213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47736d17-2f96-49b0-a1a8-601a73e35ade None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.846213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47736d17-2f96-49b0-a1a8-601a73e35ade None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.846213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47736d17-2f96-49b0-a1a8-601a73e35ade None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.846213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 319/634] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:06.846213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47736d17-2f96-49b0-a1a8-601a73e35ade None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:06.846684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 316/635] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:06.846684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df08507-4e93-4f1b-86a2-f235e938e060 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:06.944735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df08507-4e93-4f1b-86a2-f235e938e060 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:06.948286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47736d17-2f96-49b0-a1a8-601a73e35ade None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:06.977001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46408286-b901-4dbb-b76a-99dc9c05e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:06.977779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46408286-b901-4dbb-b76a-99dc9c05e522 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.978093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46408286-b901-4dbb-b76a-99dc9c05e522 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.978368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46408286-b901-4dbb-b76a-99dc9c05e522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.979365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ab531-5aa1-4646-8d37-4ad22b8c90f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:06.979995 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ab531-5aa1-4646-8d37-4ad22b8c90f7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:06.980271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ab531-5aa1-4646-8d37-4ad22b8c90f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:06.980538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ab531-5aa1-4646-8d37-4ad22b8c90f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:06.988685 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46408286-b901-4dbb-b76a-99dc9c05e522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:06.990147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46408286-b901-4dbb-b76a-99dc9c05e522 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-46408286-b901-4dbb-b76a-99dc9c05e522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:07.007759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:07.008655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:07.009575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:07.009575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:07.009575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:07.009575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:07.009575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 317/636] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:07.010309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c968cc-64f7-48a7-be1d-0303f2968dce None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.010422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c968cc-64f7-48a7-be1d-0303f2968dce None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.010625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c968cc-64f7-48a7-be1d-0303f2968dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.025983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-60c968cc-64f7-48a7-be1d-0303f2968dce None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:07.027173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-60c968cc-64f7-48a7-be1d-0303f2968dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:07.052738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ab531-5aa1-4646-8d37-4ad22b8c90f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:07.054441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ab531-5aa1-4646-8d37-4ad22b8c90f7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.094635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 318/637] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:07.095710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c968cc-64f7-48a7-be1d-0303f2968dce None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.167339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 320/638] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:29:07.168114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ab531-5aa1-4646-8d37-4ad22b8c90f7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.209350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c968cc-64f7-48a7-be1d-0303f2968dce None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.247559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc60ea-7939-4f84-93bd-3fae53ee00dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.248351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc60ea-7939-4f84-93bd-3fae53ee00dd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.248627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc60ea-7939-4f84-93bd-3fae53ee00dd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.248895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc60ea-7939-4f84-93bd-3fae53ee00dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.258812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc60ea-7939-4f84-93bd-3fae53ee00dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-39fc60ea-7939-4f84-93bd-3fae53ee00dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:07.266407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:07.267362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:07.268212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 319/639] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:07.269176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc60ea-7939-4f84-93bd-3fae53ee00dd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.277108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ab531-5aa1-4646-8d37-4ad22b8c90f7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.311140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1a68c-a159-4101-a5cd-3261eaf8a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.312226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1a68c-a159-4101-a5cd-3261eaf8a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.312707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1a68c-a159-4101-a5cd-3261eaf8a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.313189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1a68c-a159-4101-a5cd-3261eaf8a2d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.314142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1a68c-a159-4101-a5cd-3261eaf8a2d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:07.314643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1a68c-a159-4101-a5cd-3261eaf8a2d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:07.316200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1a68c-a159-4101-a5cd-3261eaf8a2d5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.328096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 321/640] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:07.329264 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1a68c-a159-4101-a5cd-3261eaf8a2d5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.374043 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc60ea-7939-4f84-93bd-3fae53ee00dd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.404937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d08174-504a-4f6a-ac52-738d9069e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.406362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d08174-504a-4f6a-ac52-738d9069e67d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.406644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d08174-504a-4f6a-ac52-738d9069e67d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.406914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d08174-504a-4f6a-ac52-738d9069e67d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.416550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d08174-504a-4f6a-ac52-738d9069e67d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a8d08174-504a-4f6a-ac52-738d9069e67d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:07.424709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:07.425675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:07.426577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:07.427216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1a68c-a159-4101-a5cd-3261eaf8a2d5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.427290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 320/641] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:07.427290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d08174-504a-4f6a-ac52-738d9069e67d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.461790 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e07b5-e4f1-490a-995b-109076dea111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.462536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e07b5-e4f1-490a-995b-109076dea111 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.462815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e07b5-e4f1-490a-995b-109076dea111 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.463082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e07b5-e4f1-490a-995b-109076dea111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.474625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e07b5-e4f1-490a-995b-109076dea111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:07.476144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e07b5-e4f1-490a-995b-109076dea111 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-717e07b5-e4f1-490a-995b-109076dea111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:07.492980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:07.493972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:07.495012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:07.495012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:07.495012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:07.495012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:07.495012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 322/642] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:07.495012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e07b5-e4f1-490a-995b-109076dea111 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.528450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d08174-504a-4f6a-ac52-738d9069e67d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.560633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb334a4-79bd-41bf-9cd8-579ce6c6dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.561291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb334a4-79bd-41bf-9cd8-579ce6c6dffd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.561596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb334a4-79bd-41bf-9cd8-579ce6c6dffd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.561868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb334a4-79bd-41bf-9cd8-579ce6c6dffd None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.562640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb334a4-79bd-41bf-9cd8-579ce6c6dffd None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:07.562945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb334a4-79bd-41bf-9cd8-579ce6c6dffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:07.564311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb334a4-79bd-41bf-9cd8-579ce6c6dffd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.572516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 321/643] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:07.573421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb334a4-79bd-41bf-9cd8-579ce6c6dffd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.593393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e07b5-e4f1-490a-995b-109076dea111 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.626079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd299-8ba5-4631-9f3a-d02d11b14208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.626864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd299-8ba5-4631-9f3a-d02d11b14208 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.627138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd299-8ba5-4631-9f3a-d02d11b14208 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.627407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd299-8ba5-4631-9f3a-d02d11b14208 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.634530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd299-8ba5-4631-9f3a-d02d11b14208 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:07.635946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd299-8ba5-4631-9f3a-d02d11b14208 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-55dcd299-8ba5-4631-9f3a-d02d11b14208 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:07.649923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:07.650928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:07.651963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 323/644] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:07.654752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd299-8ba5-4631-9f3a-d02d11b14208 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.670419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb334a4-79bd-41bf-9cd8-579ce6c6dffd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.703356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e86db-61b1-4b11-8124-1cb5c58badf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.704026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e86db-61b1-4b11-8124-1cb5c58badf9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.704305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e86db-61b1-4b11-8124-1cb5c58badf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.704577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e86db-61b1-4b11-8124-1cb5c58badf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.705320 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e86db-61b1-4b11-8124-1cb5c58badf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:07.705626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e86db-61b1-4b11-8124-1cb5c58badf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:07.707034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e86db-61b1-4b11-8124-1cb5c58badf9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.719948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 322/645] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:07.719948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e86db-61b1-4b11-8124-1cb5c58badf9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.751836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd299-8ba5-4631-9f3a-d02d11b14208 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.784289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545a95f-a282-4c6d-8589-fb25fe51ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.784945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545a95f-a282-4c6d-8589-fb25fe51ff28 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.785220 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545a95f-a282-4c6d-8589-fb25fe51ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.785489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545a95f-a282-4c6d-8589-fb25fe51ff28 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.786234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545a95f-a282-4c6d-8589-fb25fe51ff28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:07.786535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545a95f-a282-4c6d-8589-fb25fe51ff28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:07.787923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545a95f-a282-4c6d-8589-fb25fe51ff28 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.803867 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 324/646] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:07.803867 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545a95f-a282-4c6d-8589-fb25fe51ff28 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.810452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e86db-61b1-4b11-8124-1cb5c58badf9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.843412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28640410-ee17-41d6-8c54-f699a5c7c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.844206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28640410-ee17-41d6-8c54-f699a5c7c185 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.844485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28640410-ee17-41d6-8c54-f699a5c7c185 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.844758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28640410-ee17-41d6-8c54-f699a5c7c185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.855287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28640410-ee17-41d6-8c54-f699a5c7c185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:07.856730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28640410-ee17-41d6-8c54-f699a5c7c185 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-28640410-ee17-41d6-8c54-f699a5c7c185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:07.873433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:07.875139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:07.880526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:07.880526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:07.880526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:07.880526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:07.880526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 323/647] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:07.880526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28640410-ee17-41d6-8c54-f699a5c7c185 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.904687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545a95f-a282-4c6d-8589-fb25fe51ff28 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:07.937811 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a5189-50a3-4dff-9c86-a80992951a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:07.938500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a5189-50a3-4dff-9c86-a80992951a52 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:07.938780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a5189-50a3-4dff-9c86-a80992951a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:07.939049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a5189-50a3-4dff-9c86-a80992951a52 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:07.939878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a5189-50a3-4dff-9c86-a80992951a52 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:07.940176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a5189-50a3-4dff-9c86-a80992951a52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:07.941586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a5189-50a3-4dff-9c86-a80992951a52 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:07.958989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 325/648] 10.222.0.75 () {56 vars in 1137 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:07.959796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a5189-50a3-4dff-9c86-a80992951a52 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:07.978609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28640410-ee17-41d6-8c54-f699a5c7c185 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.010897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca894a-40fd-4a6d-b83b-b70b3aa3628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.011680 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca894a-40fd-4a6d-b83b-b70b3aa3628d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.011987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca894a-40fd-4a6d-b83b-b70b3aa3628d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.012258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca894a-40fd-4a6d-b83b-b70b3aa3628d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.022557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca894a-40fd-4a6d-b83b-b70b3aa3628d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.024786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca894a-40fd-4a6d-b83b-b70b3aa3628d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-94ca894a-40fd-4a6d-b83b-b70b3aa3628d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:08.042199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:08.043122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:08.049403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:08.049403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:08.049403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:08.049403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:08.049403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 324/649] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:08.049403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca894a-40fd-4a6d-b83b-b70b3aa3628d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.073525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a5189-50a3-4dff-9c86-a80992951a52 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.108112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6fd5-fcf1-449c-b42f-90f97382e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.109507 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6fd5-fcf1-449c-b42f-90f97382e8bd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.109784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6fd5-fcf1-449c-b42f-90f97382e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.110080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6fd5-fcf1-449c-b42f-90f97382e8bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.117448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd6fd5-fcf1-449c-b42f-90f97382e8bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.118973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd6fd5-fcf1-449c-b42f-90f97382e8bd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-68fd6fd5-fcf1-449c-b42f-90f97382e8bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:08.133255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:08.134290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:08.135225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:08.135225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:08.135225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:08.135225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:08.135225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:08.135225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:08.135225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:08.135225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:08.135225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 326/650] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:08.135728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6fd5-fcf1-449c-b42f-90f97382e8bd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.153558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca894a-40fd-4a6d-b83b-b70b3aa3628d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.186164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7cd71-105d-4a3e-9845-d910ba71ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.187500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7cd71-105d-4a3e-9845-d910ba71ce3f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.187877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7cd71-105d-4a3e-9845-d910ba71ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.188279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7cd71-105d-4a3e-9845-d910ba71ce3f None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.189092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7cd71-105d-4a3e-9845-d910ba71ce3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:08.189494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7cd71-105d-4a3e-9845-d910ba71ce3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.190977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7cd71-105d-4a3e-9845-d910ba71ce3f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.202915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 325/651] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:08.203818 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7cd71-105d-4a3e-9845-d910ba71ce3f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.234911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6fd5-fcf1-449c-b42f-90f97382e8bd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.267898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430411a-4f14-430a-a7b5-f8fae99a33bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.268538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430411a-4f14-430a-a7b5-f8fae99a33bd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.268813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430411a-4f14-430a-a7b5-f8fae99a33bd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.269074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430411a-4f14-430a-a7b5-f8fae99a33bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.310087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7cd71-105d-4a3e-9845-d910ba71ce3f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.335532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430411a-4f14-430a-a7b5-f8fae99a33bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.337102 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430411a-4f14-430a-a7b5-f8fae99a33bd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.349149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07dc1-9731-4bd6-841e-ca38bb52d4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.349815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07dc1-9731-4bd6-841e-ca38bb52d4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.350127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07dc1-9731-4bd6-841e-ca38bb52d4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.350400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07dc1-9731-4bd6-841e-ca38bb52d4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.351118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f07dc1-9731-4bd6-841e-ca38bb52d4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:08.351415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f07dc1-9731-4bd6-841e-ca38bb52d4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.352777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f07dc1-9731-4bd6-841e-ca38bb52d4c5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.364263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 326/652] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:08.365013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07dc1-9731-4bd6-841e-ca38bb52d4c5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.430429 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 327/653] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:29:08.431478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430411a-4f14-430a-a7b5-f8fae99a33bd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.465302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07dc1-9731-4bd6-841e-ca38bb52d4c5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.496869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dc490-e5bb-45f0-bda6-2ec240ca109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.497462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dc490-e5bb-45f0-bda6-2ec240ca109f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.497744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dc490-e5bb-45f0-bda6-2ec240ca109f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.498044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dc490-e5bb-45f0-bda6-2ec240ca109f None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.498825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dc490-e5bb-45f0-bda6-2ec240ca109f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:08.499131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dc490-e5bb-45f0-bda6-2ec240ca109f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.500549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dc490-e5bb-45f0-bda6-2ec240ca109f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.511957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 327/654] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:08.513221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb71b9c-f5f6-4d4a-948e-e7fb6047e341 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.513508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb71b9c-f5f6-4d4a-948e-e7fb6047e341 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.513780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb71b9c-f5f6-4d4a-948e-e7fb6047e341 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.518094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 328/655] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:08.518094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb71b9c-f5f6-4d4a-948e-e7fb6047e341 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.524477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430411a-4f14-430a-a7b5-f8fae99a33bd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.555956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949bed-dfef-4da5-b2c3-0a7e8e6db830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.556725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949bed-dfef-4da5-b2c3-0a7e8e6db830 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.557002 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949bed-dfef-4da5-b2c3-0a7e8e6db830 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.557277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949bed-dfef-4da5-b2c3-0a7e8e6db830 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.564292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76949bed-dfef-4da5-b2c3-0a7e8e6db830 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.565699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76949bed-dfef-4da5-b2c3-0a7e8e6db830 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-76949bed-dfef-4da5-b2c3-0a7e8e6db830 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:08.580024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:08.580976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 328/656] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:08.581919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949bed-dfef-4da5-b2c3-0a7e8e6db830 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.614885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb71b9c-f5f6-4d4a-948e-e7fb6047e341 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.646251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f87486-1b7d-474b-a103-d2bd1e2beaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.647027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f87486-1b7d-474b-a103-d2bd1e2beaba None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.647301 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f87486-1b7d-474b-a103-d2bd1e2beaba None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.647567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f87486-1b7d-474b-a103-d2bd1e2beaba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.654354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f87486-1b7d-474b-a103-d2bd1e2beaba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.656429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f87486-1b7d-474b-a103-d2bd1e2beaba None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-89f87486-1b7d-474b-a103-d2bd1e2beaba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:08.670531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:08.671591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:08.672555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 329/657] 10.222.0.75 () {56 vars in 1093 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:08.673597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f87486-1b7d-474b-a103-d2bd1e2beaba None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.681012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949bed-dfef-4da5-b2c3-0a7e8e6db830 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.717988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43231cdc-6eeb-42aa-b503-0b1f4e820bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.718828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43231cdc-6eeb-42aa-b503-0b1f4e820bcb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.719105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43231cdc-6eeb-42aa-b503-0b1f4e820bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.719370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43231cdc-6eeb-42aa-b503-0b1f4e820bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.729256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43231cdc-6eeb-42aa-b503-0b1f4e820bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.730709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43231cdc-6eeb-42aa-b503-0b1f4e820bcb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-43231cdc-6eeb-42aa-b503-0b1f4e820bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:08.747186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:08.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:08.749735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:08.749735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:08.749735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:08.749735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:08.749735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 329/658] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:08.750053 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaa248-2cc4-4a4b-8a5e-7a166dd0205e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.750425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaa248-2cc4-4a4b-8a5e-7a166dd0205e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.750521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaa248-2cc4-4a4b-8a5e-7a166dd0205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.766158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cbfaa248-2cc4-4a4b-8a5e-7a166dd0205e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:08.767327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cbfaa248-2cc4-4a4b-8a5e-7a166dd0205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:08.776424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f87486-1b7d-474b-a103-d2bd1e2beaba None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.808448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de313027-2d88-4924-88c4-fb4dc29cc390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.809093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de313027-2d88-4924-88c4-fb4dc29cc390 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.809376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de313027-2d88-4924-88c4-fb4dc29cc390 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.809649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de313027-2d88-4924-88c4-fb4dc29cc390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.810501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de313027-2d88-4924-88c4-fb4dc29cc390 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=22c0e889e1f842b2a6081f38aabd97ac) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:08.810814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de313027-2d88-4924-88c4-fb4dc29cc390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.812756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de313027-2d88-4924-88c4-fb4dc29cc390 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.818315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 330/659] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/role_assignments?user.id=22c0e889e1f842b2a6081f38aabd97ac&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:08.819076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de313027-2d88-4924-88c4-fb4dc29cc390 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.846235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 330/660] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:08.846235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaa248-2cc4-4a4b-8a5e-7a166dd0205e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:08.931886 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaa248-2cc4-4a4b-8a5e-7a166dd0205e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.944258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de313027-2d88-4924-88c4-fb4dc29cc390 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:08.967079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025304-3b76-4de2-b5bc-3d5593ec57e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.967852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025304-3b76-4de2-b5bc-3d5593ec57e2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.968131 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025304-3b76-4de2-b5bc-3d5593ec57e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.968423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025304-3b76-4de2-b5bc-3d5593ec57e2 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.969284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4025304-3b76-4de2-b5bc-3d5593ec57e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:08.969595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4025304-3b76-4de2-b5bc-3d5593ec57e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.971343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4025304-3b76-4de2-b5bc-3d5593ec57e2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.980162 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7840134-96d1-42ab-8484-05436cb17928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:08.980906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7840134-96d1-42ab-8484-05436cb17928 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:08.981131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7840134-96d1-42ab-8484-05436cb17928 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:08.981404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7840134-96d1-42ab-8484-05436cb17928 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:08.982281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7840134-96d1-42ab-8484-05436cb17928 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:08.982591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7840134-96d1-42ab-8484-05436cb17928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:08.984060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7840134-96d1-42ab-8484-05436cb17928 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:08.994366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 331/661] 10.222.0.75 () {56 vars in 1133 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:08.994366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025304-3b76-4de2-b5bc-3d5593ec57e2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.007806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 331/662] 10.222.0.75 () {56 vars in 1139 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:09.008558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7840134-96d1-42ab-8484-05436cb17928 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.091046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025304-3b76-4de2-b5bc-3d5593ec57e2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.119792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7840134-96d1-42ab-8484-05436cb17928 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.125593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d770974-6562-44c6-bd79-903b5b60a70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.126292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d770974-6562-44c6-bd79-903b5b60a70c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.126578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d770974-6562-44c6-bd79-903b5b60a70c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.126852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d770974-6562-44c6-bd79-903b5b60a70c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.127585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d770974-6562-44c6-bd79-903b5b60a70c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:09.127978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d770974-6562-44c6-bd79-903b5b60a70c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:09.129349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d770974-6562-44c6-bd79-903b5b60a70c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:09.143016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 332/663] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:09.143016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d770974-6562-44c6-bd79-903b5b60a70c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.157704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fda693-8e55-49bd-b569-381350191936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.158535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fda693-8e55-49bd-b569-381350191936 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.158810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fda693-8e55-49bd-b569-381350191936 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.159080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fda693-8e55-49bd-b569-381350191936 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.169297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fda693-8e55-49bd-b569-381350191936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-54fda693-8e55-49bd-b569-381350191936 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:09.177456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:09.178614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:09.179626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 332/664] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:09.180461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fda693-8e55-49bd-b569-381350191936 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.244561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d770974-6562-44c6-bd79-903b5b60a70c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.278095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be9307-aa2c-4a71-8594-b950e8f50772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.278683 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be9307-aa2c-4a71-8594-b950e8f50772 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.278958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be9307-aa2c-4a71-8594-b950e8f50772 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.279225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be9307-aa2c-4a71-8594-b950e8f50772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.279801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fda693-8e55-49bd-b569-381350191936 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.312978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebfa41-d061-42cb-9e10-a7d01d46a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.313619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebfa41-d061-42cb-9e10-a7d01d46a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.313896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebfa41-d061-42cb-9e10-a7d01d46a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.314207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebfa41-d061-42cb-9e10-a7d01d46a4e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.347382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be9307-aa2c-4a71-8594-b950e8f50772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:09.348897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be9307-aa2c-4a71-8594-b950e8f50772 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:09.379090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebfa41-d061-42cb-9e10-a7d01d46a4e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:09.380546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebfa41-d061-42cb-9e10-a7d01d46a4e1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:09.449031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 333/665] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:29:09.449031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be9307-aa2c-4a71-8594-b950e8f50772 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.478872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 333/666] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:29:09.478872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebfa41-d061-42cb-9e10-a7d01d46a4e1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.544482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be9307-aa2c-4a71-8594-b950e8f50772 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.569538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebfa41-d061-42cb-9e10-a7d01d46a4e1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.579360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4204c-a649-4fa3-bb6f-4d40b76bbd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.580370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4204c-a649-4fa3-bb6f-4d40b76bbd74 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.580643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4204c-a649-4fa3-bb6f-4d40b76bbd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.580913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4204c-a649-4fa3-bb6f-4d40b76bbd74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.587549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4204c-a649-4fa3-bb6f-4d40b76bbd74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:09.588984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4204c-a649-4fa3-bb6f-4d40b76bbd74 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2ce4204c-a649-4fa3-bb6f-4d40b76bbd74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:09.603017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:09.603916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:09.604788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:09.604788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:09.604788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:09.604788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:09.604788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:09.604788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:09.604788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:09.604788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:09.604788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 334/667] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:09.605263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4204c-a649-4fa3-bb6f-4d40b76bbd74 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.610430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82365dd-6822-43ed-8ecf-347002e06528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.611102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82365dd-6822-43ed-8ecf-347002e06528 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.611385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82365dd-6822-43ed-8ecf-347002e06528 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.611659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82365dd-6822-43ed-8ecf-347002e06528 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.612408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82365dd-6822-43ed-8ecf-347002e06528 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:09.612724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82365dd-6822-43ed-8ecf-347002e06528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:09.614106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82365dd-6822-43ed-8ecf-347002e06528 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:09.626288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 334/668] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:09.626288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82365dd-6822-43ed-8ecf-347002e06528 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.700736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4204c-a649-4fa3-bb6f-4d40b76bbd74 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.722229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82365dd-6822-43ed-8ecf-347002e06528 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.733836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee190e-e6bb-458c-a87e-f012eaab90ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.734844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee190e-e6bb-458c-a87e-f012eaab90ae None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.735280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee190e-e6bb-458c-a87e-f012eaab90ae None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.735553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee190e-e6bb-458c-a87e-f012eaab90ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.745916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee190e-e6bb-458c-a87e-f012eaab90ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:09.747408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee190e-e6bb-458c-a87e-f012eaab90ae None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:09.754636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71428d74-1c41-4b94-bc38-098803d176d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.755803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428d74-1c41-4b94-bc38-098803d176d7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.756086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428d74-1c41-4b94-bc38-098803d176d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.756741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428d74-1c41-4b94-bc38-098803d176d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-40ee190e-e6bb-458c-a87e-f012eaab90ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:09.765770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:09.766689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:09.768167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:09.768167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:09.768167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:09.768167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:09.768167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 335/669] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:09.768167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee190e-e6bb-458c-a87e-f012eaab90ae None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.769109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71428d74-1c41-4b94-bc38-098803d176d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:09.771045 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71428d74-1c41-4b94-bc38-098803d176d7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-71428d74-1c41-4b94-bc38-098803d176d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:09.788881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:09.789815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:09.790737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:09.790737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:09.790737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:09.790737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:09.794632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 335/670] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:09.795205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71428d74-1c41-4b94-bc38-098803d176d7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.866507 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee190e-e6bb-458c-a87e-f012eaab90ae None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.893544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71428d74-1c41-4b94-bc38-098803d176d7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:09.899081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a00c2-ba0c-435c-aecd-4c3daa4d0304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.899789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a00c2-ba0c-435c-aecd-4c3daa4d0304 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.900074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a00c2-ba0c-435c-aecd-4c3daa4d0304 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.900347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a00c2-ba0c-435c-aecd-4c3daa4d0304 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.901173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a00c2-ba0c-435c-aecd-4c3daa4d0304 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:09.901479 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a00c2-ba0c-435c-aecd-4c3daa4d0304 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:09.902935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a00c2-ba0c-435c-aecd-4c3daa4d0304 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:09.919507 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 336/671] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:09.919507 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a00c2-ba0c-435c-aecd-4c3daa4d0304 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:09.932271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0acedf-7ddb-4e04-9d39-7dc0ca998c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:09.933060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0acedf-7ddb-4e04-9d39-7dc0ca998c5d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:09.933343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0acedf-7ddb-4e04-9d39-7dc0ca998c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:09.933613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0acedf-7ddb-4e04-9d39-7dc0ca998c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:09.943942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0acedf-7ddb-4e04-9d39-7dc0ca998c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:09.945378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0acedf-7ddb-4e04-9d39-7dc0ca998c5d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9a0acedf-7ddb-4e04-9d39-7dc0ca998c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:09.962558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:09.963462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:09.964351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:09.964351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:09.964351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:09.964351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:09.964351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 336/672] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:09.964642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0acedf-7ddb-4e04-9d39-7dc0ca998c5d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.026687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a00c2-ba0c-435c-aecd-4c3daa4d0304 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.060484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdbef-bdee-4c96-91fc-1da7e2303384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.061077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdbef-bdee-4c96-91fc-1da7e2303384 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.061381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdbef-bdee-4c96-91fc-1da7e2303384 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.061656 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdbef-bdee-4c96-91fc-1da7e2303384 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.062416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fdbef-bdee-4c96-91fc-1da7e2303384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:10.062722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fdbef-bdee-4c96-91fc-1da7e2303384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.064113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fdbef-bdee-4c96-91fc-1da7e2303384 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.078346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 337/673] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:10.078507 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0acedf-7ddb-4e04-9d39-7dc0ca998c5d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.078912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdbef-bdee-4c96-91fc-1da7e2303384 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.115431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f668-2891-4fdc-919b-f0d66b6b0483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.116097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f668-2891-4fdc-919b-f0d66b6b0483 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.116376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f668-2891-4fdc-919b-f0d66b6b0483 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.116646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f668-2891-4fdc-919b-f0d66b6b0483 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.117366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f668-2891-4fdc-919b-f0d66b6b0483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:10.117666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f668-2891-4fdc-919b-f0d66b6b0483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.119482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f668-2891-4fdc-919b-f0d66b6b0483 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.135423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 337/674] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:10.135423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f668-2891-4fdc-919b-f0d66b6b0483 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.187922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdbef-bdee-4c96-91fc-1da7e2303384 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.220797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f1ef2-a862-444d-99f8-ff0a418c3cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.221719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f1ef2-a862-444d-99f8-ff0a418c3cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.222019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f1ef2-a862-444d-99f8-ff0a418c3cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.222294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f1ef2-a862-444d-99f8-ff0a418c3cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.223114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f1ef2-a862-444d-99f8-ff0a418c3cf9 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=3196743ff7564c16b3cfdae4f0008075) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:10.223423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f1ef2-a862-444d-99f8-ff0a418c3cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.224856 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f1ef2-a862-444d-99f8-ff0a418c3cf9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.229727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f668-2891-4fdc-919b-f0d66b6b0483 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.238282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 338/675] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/role_assignments?user.id=3196743ff7564c16b3cfdae4f0008075&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:10.238282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f1ef2-a862-444d-99f8-ff0a418c3cf9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.277326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5cda-0589-4692-b619-9f7d72521895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.278025 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5cda-0589-4692-b619-9f7d72521895 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.278410 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5cda-0589-4692-b619-9f7d72521895 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.278689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5cda-0589-4692-b619-9f7d72521895 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.279426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d5cda-0589-4692-b619-9f7d72521895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:10.279728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d5cda-0589-4692-b619-9f7d72521895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.281174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d5cda-0589-4692-b619-9f7d72521895 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.299602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 338/676] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:10.300609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5cda-0589-4692-b619-9f7d72521895 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.345135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f1ef2-a862-444d-99f8-ff0a418c3cf9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.380879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc203f-d63e-4beb-9b86-a987ac94a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.381681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc203f-d63e-4beb-9b86-a987ac94a431 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.381962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc203f-d63e-4beb-9b86-a987ac94a431 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.382281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc203f-d63e-4beb-9b86-a987ac94a431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.390422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc203f-d63e-4beb-9b86-a987ac94a431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.391909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc203f-d63e-4beb-9b86-a987ac94a431 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-14dc203f-d63e-4beb-9b86-a987ac94a431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:10.407123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:10.408096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:10.408990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:10.408990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:10.408990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:10.408990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:10.408990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:10.408990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:10.408990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:10.408990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:10.408990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 339/677] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:10.409515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc203f-d63e-4beb-9b86-a987ac94a431 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.413438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5cda-0589-4692-b619-9f7d72521895 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.450642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3f3ce-54e4-4c82-802b-1cf6be31b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.450966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f3ce-54e4-4c82-802b-1cf6be31b365 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.451207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f3ce-54e4-4c82-802b-1cf6be31b365 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.451475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f3ce-54e4-4c82-802b-1cf6be31b365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.460986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3f3ce-54e4-4c82-802b-1cf6be31b365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.462858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3f3ce-54e4-4c82-802b-1cf6be31b365 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-12d3f3ce-54e4-4c82-802b-1cf6be31b365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:10.478746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:10.479749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:10.480642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:10.480642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:10.480642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:10.480642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:10.480642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:10.480642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:10.480642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:10.480642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:10.483017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 339/678] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:10.483981 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3f3ce-54e4-4c82-802b-1cf6be31b365 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.523186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc203f-d63e-4beb-9b86-a987ac94a431 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.566137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f4b68-cbf8-4d40-8e05-0a7e1b0829aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.566956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f4b68-cbf8-4d40-8e05-0a7e1b0829aa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.567247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f4b68-cbf8-4d40-8e05-0a7e1b0829aa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.567520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f4b68-cbf8-4d40-8e05-0a7e1b0829aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.574770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f4b68-cbf8-4d40-8e05-0a7e1b0829aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.576195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f4b68-cbf8-4d40-8e05-0a7e1b0829aa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-261f4b68-cbf8-4d40-8e05-0a7e1b0829aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:10.593787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:10.594843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:10.595840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 340/679] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:10.596735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f4b68-cbf8-4d40-8e05-0a7e1b0829aa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.603534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3f3ce-54e4-4c82-802b-1cf6be31b365 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.640038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fce90-a084-484d-98ca-eccffbdfc1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.640761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fce90-a084-484d-98ca-eccffbdfc1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.641049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fce90-a084-484d-98ca-eccffbdfc1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.641329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fce90-a084-484d-98ca-eccffbdfc1e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.642141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fce90-a084-484d-98ca-eccffbdfc1e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:10.642452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fce90-a084-484d-98ca-eccffbdfc1e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.644017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fce90-a084-484d-98ca-eccffbdfc1e1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.656237 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 340/680] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:10.656916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fce90-a084-484d-98ca-eccffbdfc1e1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.704445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f4b68-cbf8-4d40-8e05-0a7e1b0829aa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.738686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c09d2-f524-4205-8ea2-78938516728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.739356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c09d2-f524-4205-8ea2-78938516728c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.739635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c09d2-f524-4205-8ea2-78938516728c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.739905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c09d2-f524-4205-8ea2-78938516728c None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.740693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c09d2-f524-4205-8ea2-78938516728c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:10.740996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c09d2-f524-4205-8ea2-78938516728c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.742454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c09d2-f524-4205-8ea2-78938516728c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.755208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 341/681] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:10.756162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c09d2-f524-4205-8ea2-78938516728c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.764162 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fce90-a084-484d-98ca-eccffbdfc1e1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.798200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884cbb8-16a1-44c7-913b-906a9fe6ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.798873 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884cbb8-16a1-44c7-913b-906a9fe6ff7f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.799197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884cbb8-16a1-44c7-913b-906a9fe6ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.799479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884cbb8-16a1-44c7-913b-906a9fe6ff7f None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.800318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884cbb8-16a1-44c7-913b-906a9fe6ff7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:10.800627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884cbb8-16a1-44c7-913b-906a9fe6ff7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.802078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884cbb8-16a1-44c7-913b-906a9fe6ff7f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.820332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 341/682] 10.222.0.75 () {56 vars in 1135 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:10.821270 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884cbb8-16a1-44c7-913b-906a9fe6ff7f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.854862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c09d2-f524-4205-8ea2-78938516728c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.891103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a3a32-8c79-4eb0-be61-6b52316f8fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.891879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a3a32-8c79-4eb0-be61-6b52316f8fea None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.892038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a3a32-8c79-4eb0-be61-6b52316f8fea None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.892280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a3a32-8c79-4eb0-be61-6b52316f8fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.893108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a3a32-8c79-4eb0-be61-6b52316f8fea None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8ef90c1c9c784d8792b3afe6e8e7fb31) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:10.893415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a3a32-8c79-4eb0-be61-6b52316f8fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.894874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a3a32-8c79-4eb0-be61-6b52316f8fea None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.906267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 342/683] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/role_assignments?user.id=8ef90c1c9c784d8792b3afe6e8e7fb31&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:10.907194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a3a32-8c79-4eb0-be61-6b52316f8fea None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:10.923227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884cbb8-16a1-44c7-913b-906a9fe6ff7f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:10.963687 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcc9a4-b264-438c-8d41-aee9b28d5697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:10.964381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc9a4-b264-438c-8d41-aee9b28d5697 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:10.964666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc9a4-b264-438c-8d41-aee9b28d5697 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:10.964945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc9a4-b264-438c-8d41-aee9b28d5697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:10.965824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcc9a4-b264-438c-8d41-aee9b28d5697 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=03e9f522282644e2aad2eefba7509f77) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:10.966170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcc9a4-b264-438c-8d41-aee9b28d5697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:10.967719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcc9a4-b264-438c-8d41-aee9b28d5697 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:10.975351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 342/684] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/role_assignments?user.id=03e9f522282644e2aad2eefba7509f77&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:11.072080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a3a32-8c79-4eb0-be61-6b52316f8fea None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:11.124809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462933e-2058-45c3-af8e-adc5e483bfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:11.125412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462933e-2058-45c3-af8e-adc5e483bfcf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:11.125692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462933e-2058-45c3-af8e-adc5e483bfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:11.125962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462933e-2058-45c3-af8e-adc5e483bfcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:11.140109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb8b45-e031-4980-a536-7d6613b06acd None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:11.140645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb8b45-e031-4980-a536-7d6613b06acd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:11.140757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb8b45-e031-4980-a536-7d6613b06acd None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:11.142318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 343/685] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:11.149182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076da951-1a4d-45c5-b4b0-1d99b597c649 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:11.149712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076da951-1a4d-45c5-b4b0-1d99b597c649 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:11.150265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076da951-1a4d-45c5-b4b0-1d99b597c649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:11.171508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-076da951-1a4d-45c5-b4b0-1d99b597c649 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:11.175884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-076da951-1a4d-45c5-b4b0-1d99b597c649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:11.238560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462933e-2058-45c3-af8e-adc5e483bfcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:11.240035 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462933e-2058-45c3-af8e-adc5e483bfcf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:11.270673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 344/686] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:29:11.294743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076da951-1a4d-45c5-b4b0-1d99b597c649 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:11.372994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 343/687] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:29:11.380471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462933e-2058-45c3-af8e-adc5e483bfcf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:11.415038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076da951-1a4d-45c5-b4b0-1d99b597c649 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:11.471535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb05ec-1aba-4d93-b593-7377a2b6af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:11.472332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb05ec-1aba-4d93-b593-7377a2b6af3a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:11.472610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb05ec-1aba-4d93-b593-7377a2b6af3a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:11.472878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb05ec-1aba-4d93-b593-7377a2b6af3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:11.496105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb05ec-1aba-4d93-b593-7377a2b6af3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:11.497584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb05ec-1aba-4d93-b593-7377a2b6af3a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:11.518049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462933e-2058-45c3-af8e-adc5e483bfcf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-22cb05ec-1aba-4d93-b593-7377a2b6af3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:11.529901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:11.531009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:11.532288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:11.532288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:11.532288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:11.532288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:11.532288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 345/688] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:11.538465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb05ec-1aba-4d93-b593-7377a2b6af3a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:11.563197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87fb04-88b7-43fe-a208-6cb3304951de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:11.563987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87fb04-88b7-43fe-a208-6cb3304951de None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:11.564270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87fb04-88b7-43fe-a208-6cb3304951de None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:11.564543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87fb04-88b7-43fe-a208-6cb3304951de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:11.579187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87fb04-88b7-43fe-a208-6cb3304951de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:11.581057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87fb04-88b7-43fe-a208-6cb3304951de None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4d87fb04-88b7-43fe-a208-6cb3304951de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:11.600968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:11.603177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:11.604076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:11.604076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:11.604076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:11.604076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:11.604076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 344/689] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:11.615160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87fb04-88b7-43fe-a208-6cb3304951de None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:11.689362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb05ec-1aba-4d93-b593-7377a2b6af3a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:11.735647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1777a-9496-4a40-b440-48af3727bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:11.736382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1777a-9496-4a40-b440-48af3727bb9b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:11.736667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1777a-9496-4a40-b440-48af3727bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:11.736942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1777a-9496-4a40-b440-48af3727bb9b None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:11.737780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1777a-9496-4a40-b440-48af3727bb9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:11.738115 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1777a-9496-4a40-b440-48af3727bb9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:11.739494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1777a-9496-4a40-b440-48af3727bb9b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:11.760447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 346/690] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:11.767363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1777a-9496-4a40-b440-48af3727bb9b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:11.777261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87fb04-88b7-43fe-a208-6cb3304951de None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:11.816653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137e132-cc08-4d8c-a563-22603d28aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:11.817310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e132-cc08-4d8c-a563-22603d28aff3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:11.817586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e132-cc08-4d8c-a563-22603d28aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:11.817853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e132-cc08-4d8c-a563-22603d28aff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:11.818593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137e132-cc08-4d8c-a563-22603d28aff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:11.818890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137e132-cc08-4d8c-a563-22603d28aff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:11.820249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137e132-cc08-4d8c-a563-22603d28aff3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:11.844055 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 345/691] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:11.851118 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137e132-cc08-4d8c-a563-22603d28aff3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:11.917345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1777a-9496-4a40-b440-48af3727bb9b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:11.950985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137e132-cc08-4d8c-a563-22603d28aff3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:11.960583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58c8a-bd4c-4a18-b44f-3889a5d52fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:11.961315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58c8a-bd4c-4a18-b44f-3889a5d52fa5 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:11.961602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58c8a-bd4c-4a18-b44f-3889a5d52fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:11.961879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58c8a-bd4c-4a18-b44f-3889a5d52fa5 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:11.962619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58c8a-bd4c-4a18-b44f-3889a5d52fa5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:11.964056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58c8a-bd4c-4a18-b44f-3889a5d52fa5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:11.984933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f14b8-3331-47d2-8764-db9dc6433a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:11.985769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f14b8-3331-47d2-8764-db9dc6433a99 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:11.986080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f14b8-3331-47d2-8764-db9dc6433a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:11.986350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f14b8-3331-47d2-8764-db9dc6433a99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:11.995187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f14b8-3331-47d2-8764-db9dc6433a99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:11.996711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f14b8-3331-47d2-8764-db9dc6433a99 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:11.998307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 347/692] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:29:11 2022] POST /identity/v3/users => generated 254 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9e7f14b8-3331-47d2-8764-db9dc6433a99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:12.019603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:12.021789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:12.024031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:12.024031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:12.024031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:12.024031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:12.024031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:12.024031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:12.024031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:12.024031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:12.027209 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 346/693] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:12.028180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58c8a-bd4c-4a18-b44f-3889a5d52fa5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:12.151639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58c8a-bd4c-4a18-b44f-3889a5d52fa5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:12.193423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909130b-6e18-4763-a825-2b42a940c543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:12.194130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909130b-6e18-4763-a825-2b42a940c543 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:12.194428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909130b-6e18-4763-a825-2b42a940c543 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:12.194687 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909130b-6e18-4763-a825-2b42a940c543 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:12.195491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909130b-6e18-4763-a825-2b42a940c543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:12.195801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909130b-6e18-4763-a825-2b42a940c543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:12.197266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909130b-6e18-4763-a825-2b42a940c543 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:12.211134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 348/694] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:12.219094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f14b8-3331-47d2-8764-db9dc6433a99 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:12.340551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f14b8-3331-47d2-8764-db9dc6433a99 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:12.376813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01ee0a-df80-4306-8e8e-9921c8d219e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:12.377470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01ee0a-df80-4306-8e8e-9921c8d219e3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:12.377748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01ee0a-df80-4306-8e8e-9921c8d219e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:12.378066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01ee0a-df80-4306-8e8e-9921c8d219e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:12.378908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01ee0a-df80-4306-8e8e-9921c8d219e3 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=db2c811cad8a490891834991a6101984) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:12.379265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01ee0a-df80-4306-8e8e-9921c8d219e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:12.380707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01ee0a-df80-4306-8e8e-9921c8d219e3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:12.387188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 347/695] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:12 2022] GET /identity/v3/role_assignments?user.id=db2c811cad8a490891834991a6101984&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:12.908970 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32220c-d536-429b-be9a-8e8f1bac7293 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:12.909255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32220c-d536-429b-be9a-8e8f1bac7293 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:12.909528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32220c-d536-429b-be9a-8e8f1bac7293 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:12.910904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 349/696] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:12.916260 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e9f8-b9e2-4323-88e8-9b677c4a3de5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:12.916548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e9f8-b9e2-4323-88e8-9b677c4a3de5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:12.916820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e9f8-b9e2-4323-88e8-9b677c4a3de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:12.934950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b285e9f8-b9e2-4323-88e8-9b677c4a3de5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:12.936262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b285e9f8-b9e2-4323-88e8-9b677c4a3de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:13.022470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 348/697] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:13.053048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32220c-d536-429b-be9a-8e8f1bac7293 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:13.182824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32220c-d536-429b-be9a-8e8f1bac7293 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:13.236612 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311aa5-8a77-47eb-8c0b-e1b427de64ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:13.237444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311aa5-8a77-47eb-8c0b-e1b427de64ea None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:13.237727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311aa5-8a77-47eb-8c0b-e1b427de64ea None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:13.238026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311aa5-8a77-47eb-8c0b-e1b427de64ea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:13.238684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311aa5-8a77-47eb-8c0b-e1b427de64ea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:13.240070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311aa5-8a77-47eb-8c0b-e1b427de64ea None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e4311aa5-8a77-47eb-8c0b-e1b427de64ea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:13.260072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:13.261082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 15:29:13.261936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:13.266039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 350/698] 10.222.0.75 () {56 vars in 1129 bytes} [Tue May 17 15:29:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:13.269337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e9f8-b9e2-4323-88e8-9b677c4a3de5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:13.427353 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e9f8-b9e2-4323-88e8-9b677c4a3de5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:13.470816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b86c64-e782-41e8-a006-35bf4f922284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:13.471692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b86c64-e782-41e8-a006-35bf4f922284 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:13.471968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b86c64-e782-41e8-a006-35bf4f922284 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:13.472244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b86c64-e782-41e8-a006-35bf4f922284 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:13.472960 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b86c64-e782-41e8-a006-35bf4f922284 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:13.473266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b86c64-e782-41e8-a006-35bf4f922284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:13.474656 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b86c64-e782-41e8-a006-35bf4f922284 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:13.479617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 349/699] 10.222.0.75 () {56 vars in 1124 bytes} [Tue May 17 15:29:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:13.485626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311aa5-8a77-47eb-8c0b-e1b427de64ea None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:13.551698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc1d9f-c6f9-47e1-8e8c-f5d756b36bb8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:13.552029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc1d9f-c6f9-47e1-8e8c-f5d756b36bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:13.552238 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc1d9f-c6f9-47e1-8e8c-f5d756b36bb8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:13.554367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 350/700] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:13.560254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42783f38-b244-4ffb-9941-b669ef450a01 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:13.560548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42783f38-b244-4ffb-9941-b669ef450a01 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:13.560830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42783f38-b244-4ffb-9941-b669ef450a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:13.585339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-42783f38-b244-4ffb-9941-b669ef450a01 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:13.586605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-42783f38-b244-4ffb-9941-b669ef450a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:13.613412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311aa5-8a77-47eb-8c0b-e1b427de64ea None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:13.647072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aeb86-625d-4053-adea-1aa72bcaf6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:13.648186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aeb86-625d-4053-adea-1aa72bcaf6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:13.648696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aeb86-625d-4053-adea-1aa72bcaf6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:13.649161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aeb86-625d-4053-adea-1aa72bcaf6b8 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:13.650091 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aeb86-625d-4053-adea-1aa72bcaf6b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:13.650612 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aeb86-625d-4053-adea-1aa72bcaf6b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:13.652201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aeb86-625d-4053-adea-1aa72bcaf6b8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:13.659682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 351/701] 10.222.0.75 () {56 vars in 1124 bytes} [Tue May 17 15:29:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:13.687866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 351/702] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:13.710576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aeb86-625d-4053-adea-1aa72bcaf6b8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:13.820782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aeb86-625d-4053-adea-1aa72bcaf6b8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:13.857540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e755a7c-c9ba-4083-8e3a-7aa8deef4fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:13.859303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e755a7c-c9ba-4083-8e3a-7aa8deef4fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:13.859786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e755a7c-c9ba-4083-8e3a-7aa8deef4fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:13.860273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e755a7c-c9ba-4083-8e3a-7aa8deef4fb0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:13.861123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e755a7c-c9ba-4083-8e3a-7aa8deef4fb0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:13.862738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e755a7c-c9ba-4083-8e3a-7aa8deef4fb0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9e755a7c-c9ba-4083-8e3a-7aa8deef4fb0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:13.875914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:13.876947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 15:29:13.877789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:13.880671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 352/703] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:13 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:13.886629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42783f38-b244-4ffb-9941-b669ef450a01 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:13.948999 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2de29-f8bd-4aee-90c9-abd8cf9fe5aa None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:13.949348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2de29-f8bd-4aee-90c9-abd8cf9fe5aa None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:13.949558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2de29-f8bd-4aee-90c9-abd8cf9fe5aa None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:13.951009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 353/704] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:13.968078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51b1d2-afda-4219-a63b-445a37cce28f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:13.968394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51b1d2-afda-4219-a63b-445a37cce28f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:13.968642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51b1d2-afda-4219-a63b-445a37cce28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:13.995110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42783f38-b244-4ffb-9941-b669ef450a01 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:14.008928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2f51b1d2-afda-4219-a63b-445a37cce28f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:14.010176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2f51b1d2-afda-4219-a63b-445a37cce28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:14.044704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa24e-c600-4b9c-8c07-9f79664255d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:14.045376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa24e-c600-4b9c-8c07-9f79664255d1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:14.046205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa24e-c600-4b9c-8c07-9f79664255d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:14.046480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa24e-c600-4b9c-8c07-9f79664255d1 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:14.049929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaa24e-c600-4b9c-8c07-9f79664255d1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:14.049929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaa24e-c600-4b9c-8c07-9f79664255d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:14.049929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaa24e-c600-4b9c-8c07-9f79664255d1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:14.056693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 352/705] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:14.061871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa24e-c600-4b9c-8c07-9f79664255d1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:14.115183 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 354/706] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:29:14.157128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51b1d2-afda-4219-a63b-445a37cce28f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:14.222754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa24e-c600-4b9c-8c07-9f79664255d1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:14.268587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad9d24-0f72-43c7-b441-f723c50b0646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:14.269588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad9d24-0f72-43c7-b441-f723c50b0646 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:14.270311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad9d24-0f72-43c7-b441-f723c50b0646 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:14.271864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad9d24-0f72-43c7-b441-f723c50b0646 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:14.272778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad9d24-0f72-43c7-b441-f723c50b0646 None admin] RBAC: Adding query filter params (type=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:14.274205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad9d24-0f72-43c7-b441-f723c50b0646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:14.276432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad9d24-0f72-43c7-b441-f723c50b0646 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:14.296752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 353/707] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:14.322496 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51b1d2-afda-4219-a63b-445a37cce28f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:14.365846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60011f9f-3d59-4ce4-9c4d-af62be1dc48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:14.366964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60011f9f-3d59-4ce4-9c4d-af62be1dc48e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:14.367455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60011f9f-3d59-4ce4-9c4d-af62be1dc48e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:14.367905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60011f9f-3d59-4ce4-9c4d-af62be1dc48e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:14.383930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60011f9f-3d59-4ce4-9c4d-af62be1dc48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-60011f9f-3d59-4ce4-9c4d-af62be1dc48e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:14.392515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:14.393508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:14.398707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:14.400446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 355/708] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:14.406547 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad9d24-0f72-43c7-b441-f723c50b0646 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:14.526615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad9d24-0f72-43c7-b441-f723c50b0646 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:14.561727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57f6ae-a7b1-4883-bd05-d42830d1d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:14.562433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57f6ae-a7b1-4883-bd05-d42830d1d793 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:14.562719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57f6ae-a7b1-4883-bd05-d42830d1d793 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:14.563059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57f6ae-a7b1-4883-bd05-d42830d1d793 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:14.563819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57f6ae-a7b1-4883-bd05-d42830d1d793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:14.564178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57f6ae-a7b1-4883-bd05-d42830d1d793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:14.565657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57f6ae-a7b1-4883-bd05-d42830d1d793 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:14.575086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 354/709] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:14.580895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60011f9f-3d59-4ce4-9c4d-af62be1dc48e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:14.729543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60011f9f-3d59-4ce4-9c4d-af62be1dc48e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:14.766199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c23f2-5fef-42b0-9990-5a8caeef5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:14.767358 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c23f2-5fef-42b0-9990-5a8caeef5fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:14.767857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c23f2-5fef-42b0-9990-5a8caeef5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:14.768321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c23f2-5fef-42b0-9990-5a8caeef5fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:14.779447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c23f2-5fef-42b0-9990-5a8caeef5fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:14.781748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c23f2-5fef-42b0-9990-5a8caeef5fb6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-2e7c23f2-5fef-42b0-9990-5a8caeef5fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:14.799638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:14.800581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:14.801471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:14.801471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:14.801471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:14.801471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:14.803713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 356/710] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:14.809333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57f6ae-a7b1-4883-bd05-d42830d1d793 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:14.930194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57f6ae-a7b1-4883-bd05-d42830d1d793 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:14.971193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d71a6-0226-4368-b01d-d733570e44c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:14.971857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d71a6-0226-4368-b01d-d733570e44c8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:14.972138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d71a6-0226-4368-b01d-d733570e44c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:14.972411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d71a6-0226-4368-b01d-d733570e44c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:14.973126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d71a6-0226-4368-b01d-d733570e44c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:14.973426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d71a6-0226-4368-b01d-d733570e44c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:14.974800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d71a6-0226-4368-b01d-d733570e44c8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:14.987224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 355/711] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:14.992749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c23f2-5fef-42b0-9990-5a8caeef5fb6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:15.113930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c23f2-5fef-42b0-9990-5a8caeef5fb6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:15.156588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433386af-4ff2-4eaa-9b63-fd0634685db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:15.157684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433386af-4ff2-4eaa-9b63-fd0634685db1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:15.158193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433386af-4ff2-4eaa-9b63-fd0634685db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:15.158667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433386af-4ff2-4eaa-9b63-fd0634685db1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:15.169318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433386af-4ff2-4eaa-9b63-fd0634685db1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:15.171063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433386af-4ff2-4eaa-9b63-fd0634685db1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-433386af-4ff2-4eaa-9b63-fd0634685db1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:15.187561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:15.188543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:15.189482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:15.191855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 357/712] 10.222.0.75 () {56 vars in 1093 bytes} [Tue May 17 15:29:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:15.197752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d71a6-0226-4368-b01d-d733570e44c8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:15.321980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210334c-cffb-4868-88a5-8d649f05e834 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:15.322691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210334c-cffb-4868-88a5-8d649f05e834 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:15.323580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210334c-cffb-4868-88a5-8d649f05e834 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:15.325375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 358/713] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:15.331321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8b987-65f3-431e-82b8-100cc5e00428 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:15.331899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8b987-65f3-431e-82b8-100cc5e00428 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:15.332370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8b987-65f3-431e-82b8-100cc5e00428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:15.336706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d71a6-0226-4368-b01d-d733570e44c8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:15.352213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8de8b987-65f3-431e-82b8-100cc5e00428 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:15.353694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8de8b987-65f3-431e-82b8-100cc5e00428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:15.388525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddea991-2d8f-4866-ad9b-86c6ad53b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:15.389839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddea991-2d8f-4866-ad9b-86c6ad53b041 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:15.390156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddea991-2d8f-4866-ad9b-86c6ad53b041 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:15.390455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddea991-2d8f-4866-ad9b-86c6ad53b041 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:15.391277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddea991-2d8f-4866-ad9b-86c6ad53b041 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:15.391590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddea991-2d8f-4866-ad9b-86c6ad53b041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:15.393017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddea991-2d8f-4866-ad9b-86c6ad53b041 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:15.421527 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 356/714] 10.222.0.75 () {56 vars in 1133 bytes} [Tue May 17 15:29:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:15.430866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddea991-2d8f-4866-ad9b-86c6ad53b041 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:15.474069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 359/715] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:15.475847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d73d2-30fa-48ea-94ba-6f1f7f988b52 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:15.476331 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d73d2-30fa-48ea-94ba-6f1f7f988b52 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:15.476801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d73d2-30fa-48ea-94ba-6f1f7f988b52 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:15.478550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 360/716] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:15.483953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba86a-bd2a-4096-9ee2-fd2074d8046d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:15.484499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba86a-bd2a-4096-9ee2-fd2074d8046d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:15.484970 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba86a-bd2a-4096-9ee2-fd2074d8046d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:15.502310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-393ba86a-bd2a-4096-9ee2-fd2074d8046d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:15.503829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-393ba86a-bd2a-4096-9ee2-fd2074d8046d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:15.546771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddea991-2d8f-4866-ad9b-86c6ad53b041 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:15.571152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 361/717] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 15:29:15.579235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ba86a-bd2a-4096-9ee2-fd2074d8046d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:15.583777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0093ce-fa92-4988-a9f4-090a4b62d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:15.584431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0093ce-fa92-4988-a9f4-090a4b62d300 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:15.584713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0093ce-fa92-4988-a9f4-090a4b62d300 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:15.584991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0093ce-fa92-4988-a9f4-090a4b62d300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:15.667937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0093ce-fa92-4988-a9f4-090a4b62d300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:15.669527 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0093ce-fa92-4988-a9f4-090a4b62d300 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:15.698961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ba86a-bd2a-4096-9ee2-fd2074d8046d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:15.737393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f1a68-b851-4f10-b4b0-9e570de53e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:15.739137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f1a68-b851-4f10-b4b0-9e570de53e23 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:15.739631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f1a68-b851-4f10-b4b0-9e570de53e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:15.740433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f1a68-b851-4f10-b4b0-9e570de53e23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:15.753316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f1a68-b851-4f10-b4b0-9e570de53e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-554f1a68-b851-4f10-b4b0-9e570de53e23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:15.761606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:15.762684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:15.763540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:15.767056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 362/718] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:15.768198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f1a68-b851-4f10-b4b0-9e570de53e23 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:15.880330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f1a68-b851-4f10-b4b0-9e570de53e23 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:15.896952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 357/719] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:29:15.898258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0093ce-fa92-4988-a9f4-090a4b62d300 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:15.925406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7308-b654-419b-a0e1-9e10478bae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:15.926343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7308-b654-419b-a0e1-9e10478bae50 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:15.926702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7308-b654-419b-a0e1-9e10478bae50 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:15.927049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7308-b654-419b-a0e1-9e10478bae50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:15.938328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a7308-b654-419b-a0e1-9e10478bae50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-281a7308-b654-419b-a0e1-9e10478bae50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:15.945677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:15.946708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:15.947587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:15.952263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 363/720] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:15.953414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7308-b654-419b-a0e1-9e10478bae50 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.006650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0093ce-fa92-4988-a9f4-090a4b62d300 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.041190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d26826-bc3b-49ae-aa39-64ac9915aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.042249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d26826-bc3b-49ae-aa39-64ac9915aa05 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.042738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d26826-bc3b-49ae-aa39-64ac9915aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.043246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d26826-bc3b-49ae-aa39-64ac9915aa05 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.044203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d26826-bc3b-49ae-aa39-64ac9915aa05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:16.044708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d26826-bc3b-49ae-aa39-64ac9915aa05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.046390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d26826-bc3b-49ae-aa39-64ac9915aa05 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.055661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 358/721] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:16.056742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d26826-bc3b-49ae-aa39-64ac9915aa05 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.057534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7308-b654-419b-a0e1-9e10478bae50 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.093489 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411ef7e-9b0d-48e7-827a-fe3c80ec70fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.094311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ef7e-9b0d-48e7-827a-fe3c80ec70fb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.094767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ef7e-9b0d-48e7-827a-fe3c80ec70fb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.095224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ef7e-9b0d-48e7-827a-fe3c80ec70fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.107233 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411ef7e-9b0d-48e7-827a-fe3c80ec70fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.109012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411ef7e-9b0d-48e7-827a-fe3c80ec70fb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3411ef7e-9b0d-48e7-827a-fe3c80ec70fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:16.126524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:16.127695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:16.128894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:16.128894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:16.128894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:16.128894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:16.131013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 364/722] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:16.131958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411ef7e-9b0d-48e7-827a-fe3c80ec70fb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.160703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d26826-bc3b-49ae-aa39-64ac9915aa05 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.194525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbe851-f731-40f6-ad73-d7258a889e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.195306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbe851-f731-40f6-ad73-d7258a889e86 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.195583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbe851-f731-40f6-ad73-d7258a889e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.195965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbe851-f731-40f6-ad73-d7258a889e86 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.196843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbe851-f731-40f6-ad73-d7258a889e86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:16.197216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbe851-f731-40f6-ad73-d7258a889e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.198687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbe851-f731-40f6-ad73-d7258a889e86 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.211921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 359/723] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:16.211921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbe851-f731-40f6-ad73-d7258a889e86 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.250774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411ef7e-9b0d-48e7-827a-fe3c80ec70fb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.296134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717935cc-cf53-4ecf-bd24-74868aba0d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.297539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717935cc-cf53-4ecf-bd24-74868aba0d98 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.298188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717935cc-cf53-4ecf-bd24-74868aba0d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.298652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717935cc-cf53-4ecf-bd24-74868aba0d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.314657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717935cc-cf53-4ecf-bd24-74868aba0d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.315160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbe851-f731-40f6-ad73-d7258a889e86 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.316825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717935cc-cf53-4ecf-bd24-74868aba0d98 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-717935cc-cf53-4ecf-bd24-74868aba0d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:16.341659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:16.343118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:16.344020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:16.344020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:16.344020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:16.344020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:16.346993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 365/724] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:16.348318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717935cc-cf53-4ecf-bd24-74868aba0d98 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.357535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d593e0a-dc48-40e9-ae01-0a4f6fd54063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.358273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d593e0a-dc48-40e9-ae01-0a4f6fd54063 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.358556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d593e0a-dc48-40e9-ae01-0a4f6fd54063 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.358836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d593e0a-dc48-40e9-ae01-0a4f6fd54063 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.359565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d593e0a-dc48-40e9-ae01-0a4f6fd54063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:16.359869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d593e0a-dc48-40e9-ae01-0a4f6fd54063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.361230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d593e0a-dc48-40e9-ae01-0a4f6fd54063 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.378458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 360/725] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:16.378458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d593e0a-dc48-40e9-ae01-0a4f6fd54063 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.459475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717935cc-cf53-4ecf-bd24-74868aba0d98 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.477809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d593e0a-dc48-40e9-ae01-0a4f6fd54063 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.494109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94f37d-1318-49c0-b50d-acb63de43e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.494904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94f37d-1318-49c0-b50d-acb63de43e35 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.495215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94f37d-1318-49c0-b50d-acb63de43e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.495466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94f37d-1318-49c0-b50d-acb63de43e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.506487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94f37d-1318-49c0-b50d-acb63de43e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.508407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94f37d-1318-49c0-b50d-acb63de43e35 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.513469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6b0da-0821-4531-bef9-8059564f8e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.514300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6b0da-0821-4531-bef9-8059564f8e81 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.514648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6b0da-0821-4531-bef9-8059564f8e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.514925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6b0da-0821-4531-bef9-8059564f8e81 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.515646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6b0da-0821-4531-bef9-8059564f8e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:16.515949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6b0da-0821-4531-bef9-8059564f8e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.517344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6b0da-0821-4531-bef9-8059564f8e81 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9a94f37d-1318-49c0-b50d-acb63de43e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:16.527068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:16.527980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:16.528931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:16.528931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:16.528931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:16.528931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:16.533334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 361/726] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:16.533467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 366/727] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:16.534597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6b0da-0821-4531-bef9-8059564f8e81 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.534840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12bc2b-8b68-4dbd-93b2-245f650658cc None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.535130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12bc2b-8b68-4dbd-93b2-245f650658cc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.535431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12bc2b-8b68-4dbd-93b2-245f650658cc None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.538292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 367/728] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:16.538292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12bc2b-8b68-4dbd-93b2-245f650658cc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.636510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6b0da-0821-4531-bef9-8059564f8e81 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.649300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12bc2b-8b68-4dbd-93b2-245f650658cc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.671668 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404b8c2-8464-4fc7-8953-9d8f1082a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.672458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404b8c2-8464-4fc7-8953-9d8f1082a33c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.672736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404b8c2-8464-4fc7-8953-9d8f1082a33c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.673011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404b8c2-8464-4fc7-8953-9d8f1082a33c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.679629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404b8c2-8464-4fc7-8953-9d8f1082a33c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.681047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404b8c2-8464-4fc7-8953-9d8f1082a33c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.683140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d874b-16eb-4657-be0a-46ca6648b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.683797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d874b-16eb-4657-be0a-46ca6648b39c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.684080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d874b-16eb-4657-be0a-46ca6648b39c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.684353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d874b-16eb-4657-be0a-46ca6648b39c None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.685067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d874b-16eb-4657-be0a-46ca6648b39c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:16.685372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d874b-16eb-4657-be0a-46ca6648b39c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.686777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d874b-16eb-4657-be0a-46ca6648b39c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d404b8c2-8464-4fc7-8953-9d8f1082a33c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:16.695081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:16.696170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:16.697130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:16.697130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:16.697130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:16.697130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:16.697130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:16.697130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:16.697130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:16.697130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:16.697130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 362/729] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:16.706110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 368/730] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:16.706243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404b8c2-8464-4fc7-8953-9d8f1082a33c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.706340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8bd5d-c221-4c98-a9a5-94c9e9f555dc None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.706340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8bd5d-c221-4c98-a9a5-94c9e9f555dc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.706340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8bd5d-c221-4c98-a9a5-94c9e9f555dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.721607 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-02c8bd5d-c221-4c98-a9a5-94c9e9f555dc None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:16.722735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-02c8bd5d-c221-4c98-a9a5-94c9e9f555dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:16.791304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 369/731] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:16.792464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8bd5d-c221-4c98-a9a5-94c9e9f555dc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.816234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404b8c2-8464-4fc7-8953-9d8f1082a33c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.852508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597424a-f0c5-4664-b7ac-f44917e714a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.853746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597424a-f0c5-4664-b7ac-f44917e714a1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.854301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597424a-f0c5-4664-b7ac-f44917e714a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.854753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597424a-f0c5-4664-b7ac-f44917e714a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.863077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597424a-f0c5-4664-b7ac-f44917e714a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.864810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597424a-f0c5-4664-b7ac-f44917e714a1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d597424a-f0c5-4664-b7ac-f44917e714a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:16.880014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:16.880965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:16.882105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:16.884302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 363/732] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:16.885211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597424a-f0c5-4664-b7ac-f44917e714a1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.908917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8bd5d-c221-4c98-a9a5-94c9e9f555dc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:16.942652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb069325-8a1f-4feb-950b-17840ec917e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:16.943310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb069325-8a1f-4feb-950b-17840ec917e8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:16.943592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb069325-8a1f-4feb-950b-17840ec917e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:16.943865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb069325-8a1f-4feb-950b-17840ec917e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:16.944644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb069325-8a1f-4feb-950b-17840ec917e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:16.944950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb069325-8a1f-4feb-950b-17840ec917e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:16.946476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb069325-8a1f-4feb-950b-17840ec917e8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:16.957922 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 370/733] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:16.958721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb069325-8a1f-4feb-950b-17840ec917e8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:16.986771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597424a-f0c5-4664-b7ac-f44917e714a1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:17.019850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72331940-5a66-4645-8e68-4827cca33db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:17.020643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72331940-5a66-4645-8e68-4827cca33db9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.020931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72331940-5a66-4645-8e68-4827cca33db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.021206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72331940-5a66-4645-8e68-4827cca33db9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.028709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72331940-5a66-4645-8e68-4827cca33db9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:17.030192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72331940-5a66-4645-8e68-4827cca33db9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-72331940-5a66-4645-8e68-4827cca33db9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:17.043925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:17.045020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:17.046233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 364/734] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:17.046951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72331940-5a66-4645-8e68-4827cca33db9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:17.058481 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb069325-8a1f-4feb-950b-17840ec917e8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:17.090431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39001818-acdb-4553-8a50-e160e42e9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:17.091082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001818-acdb-4553-8a50-e160e42e9051 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.091360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001818-acdb-4553-8a50-e160e42e9051 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.091631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001818-acdb-4553-8a50-e160e42e9051 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.092363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39001818-acdb-4553-8a50-e160e42e9051 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:17.093723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39001818-acdb-4553-8a50-e160e42e9051 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:17.110716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 371/735] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:29:16 2022] POST /identity/v3/services => generated 251 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:17.111528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39001818-acdb-4553-8a50-e160e42e9051 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:17.152174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72331940-5a66-4645-8e68-4827cca33db9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:17.200358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed160d-50cf-4c95-8da2-6f84e860fb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:17.202307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed160d-50cf-4c95-8da2-6f84e860fb55 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.202617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed160d-50cf-4c95-8da2-6f84e860fb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.202947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed160d-50cf-4c95-8da2-6f84e860fb55 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.203818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed160d-50cf-4c95-8da2-6f84e860fb55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:17.204130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed160d-50cf-4c95-8da2-6f84e860fb55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:17.205596 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed160d-50cf-4c95-8da2-6f84e860fb55 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:17.224390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 365/736] 10.222.0.75 () {56 vars in 1149 bytes} [Tue May 17 15:29:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:17.226222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a625f-c593-4482-90e0-96d8f072fbe7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.226696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a625f-c593-4482-90e0-96d8f072fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.227191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a625f-c593-4482-90e0-96d8f072fbe7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.229093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 366/737] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:17.230122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a625f-c593-4482-90e0-96d8f072fbe7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:17.239794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39001818-acdb-4553-8a50-e160e42e9051 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:17.275784 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f668a-5566-413d-8940-b89cdeec0308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:17.276464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f668a-5566-413d-8940-b89cdeec0308 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.276745 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f668a-5566-413d-8940-b89cdeec0308 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.277021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f668a-5566-413d-8940-b89cdeec0308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.277862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f668a-5566-413d-8940-b89cdeec0308 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8ef90c1c9c784d8792b3afe6e8e7fb31) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:17.278205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f668a-5566-413d-8940-b89cdeec0308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:17.279678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f668a-5566-413d-8940-b89cdeec0308 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:17.292648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 372/738] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:17 2022] GET /identity/v3/role_assignments?user.id=8ef90c1c9c784d8792b3afe6e8e7fb31&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=cb77715547a14bae950f68513af00d30 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:17.292648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f668a-5566-413d-8940-b89cdeec0308 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:17.364329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a625f-c593-4482-90e0-96d8f072fbe7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:17.400471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e3fbb-553e-447e-a1e6-6cd4610410db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:17.401263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e3fbb-553e-447e-a1e6-6cd4610410db None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.401610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e3fbb-553e-447e-a1e6-6cd4610410db None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.401888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e3fbb-553e-447e-a1e6-6cd4610410db None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.402774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e3fbb-553e-447e-a1e6-6cd4610410db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:17.403076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e3fbb-553e-447e-a1e6-6cd4610410db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:17.404515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e3fbb-553e-447e-a1e6-6cd4610410db None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:17.431126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f668a-5566-413d-8940-b89cdeec0308 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:17.433740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 367/739] 10.222.0.75 () {56 vars in 1135 bytes} [Tue May 17 15:29:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:17.436881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131a14-6647-439b-a183-98f086571084 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.437418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131a14-6647-439b-a183-98f086571084 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.437902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131a14-6647-439b-a183-98f086571084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.457295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a1131a14-6647-439b-a183-98f086571084 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:17.458532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a1131a14-6647-439b-a183-98f086571084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:17.474160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c32e-af78-4036-bb5e-bc8ef9c353b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:17.474870 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c32e-af78-4036-bb5e-bc8ef9c353b3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.475154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c32e-af78-4036-bb5e-bc8ef9c353b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.475430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c32e-af78-4036-bb5e-bc8ef9c353b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.541785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 368/740] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 15:29:17.542708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1131a14-6647-439b-a183-98f086571084 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:17.550739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c32e-af78-4036-bb5e-bc8ef9c353b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:17.552480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c32e-af78-4036-bb5e-bc8ef9c353b3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:17.658139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 373/741] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:29:17.659409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c32e-af78-4036-bb5e-bc8ef9c353b3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:17.663414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1131a14-6647-439b-a183-98f086571084 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:17.704137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcc0c0-e777-445a-9b42-b61483e3694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:17.705164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcc0c0-e777-445a-9b42-b61483e3694d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.705671 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcc0c0-e777-445a-9b42-b61483e3694d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.706192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcc0c0-e777-445a-9b42-b61483e3694d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.774084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c32e-af78-4036-bb5e-bc8ef9c353b3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:17.774943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcc0c0-e777-445a-9b42-b61483e3694d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:17.776398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcc0c0-e777-445a-9b42-b61483e3694d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:17.811975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ddd1-51a6-4f05-bd3a-e5ae4d2977e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:17.812559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ddd1-51a6-4f05-bd3a-e5ae4d2977e7 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:17.812843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ddd1-51a6-4f05-bd3a-e5ae4d2977e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:17.813116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ddd1-51a6-4f05-bd3a-e5ae4d2977e7 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:17.813825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2ddd1-51a6-4f05-bd3a-e5ae4d2977e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:17.815371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2ddd1-51a6-4f05-bd3a-e5ae4d2977e7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:17.832615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 374/742] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:29:17 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:17.834586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ddd1-51a6-4f05-bd3a-e5ae4d2977e7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:17.892157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 369/743] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 15:29:17.893615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcc0c0-e777-445a-9b42-b61483e3694d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:17.967096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ddd1-51a6-4f05-bd3a-e5ae4d2977e7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:18.003292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217e608-c026-4c51-9838-daf2cf47fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:18.004390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217e608-c026-4c51-9838-daf2cf47fdba None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:18.004531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217e608-c026-4c51-9838-daf2cf47fdba None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:18.004849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217e608-c026-4c51-9838-daf2cf47fdba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:18.015499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217e608-c026-4c51-9838-daf2cf47fdba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:18.017095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217e608-c026-4c51-9838-daf2cf47fdba None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:18.018676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcc0c0-e777-445a-9b42-b61483e3694d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f217e608-c026-4c51-9838-daf2cf47fdba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:18.039955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:18.040925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:18.041867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:18.041867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:18.041867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:18.041867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:18.048334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 375/744] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:18.049347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217e608-c026-4c51-9838-daf2cf47fdba None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:18.084947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb7bb-23ef-43d8-a640-4a9e74e95b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:18.085681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb7bb-23ef-43d8-a640-4a9e74e95b8c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:18.086749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb7bb-23ef-43d8-a640-4a9e74e95b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:18.087025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb7bb-23ef-43d8-a640-4a9e74e95b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:18.112026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb7bb-23ef-43d8-a640-4a9e74e95b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:18.113583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb7bb-23ef-43d8-a640-4a9e74e95b8c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-64beb7bb-23ef-43d8-a640-4a9e74e95b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:18.156432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:18.157373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:18.158323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:18.158323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:18.158323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:18.158323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:18.158323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 370/745] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:18.164143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb7bb-23ef-43d8-a640-4a9e74e95b8c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:18.204733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217e608-c026-4c51-9838-daf2cf47fdba None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:18.243484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9835-31fc-4d43-b371-62bf82abd38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:18.244554 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9835-31fc-4d43-b371-62bf82abd38d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:18.245075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9835-31fc-4d43-b371-62bf82abd38d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:18.245551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9835-31fc-4d43-b371-62bf82abd38d None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:18.246511 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9835-31fc-4d43-b371-62bf82abd38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:18.247092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9835-31fc-4d43-b371-62bf82abd38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:18.249362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9835-31fc-4d43-b371-62bf82abd38d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:18.261376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 376/746] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:18.267634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9835-31fc-4d43-b371-62bf82abd38d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:18.275010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb7bb-23ef-43d8-a640-4a9e74e95b8c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:18.309526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078dc2-3409-4535-a061-2727e0a5b142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:18.310853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078dc2-3409-4535-a061-2727e0a5b142 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:18.310853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078dc2-3409-4535-a061-2727e0a5b142 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:18.310853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078dc2-3409-4535-a061-2727e0a5b142 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:18.312045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e078dc2-3409-4535-a061-2727e0a5b142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:18.312348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e078dc2-3409-4535-a061-2727e0a5b142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:18.314590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e078dc2-3409-4535-a061-2727e0a5b142 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:18.331080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 371/747] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:18.333061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078dc2-3409-4535-a061-2727e0a5b142 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:18.388732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9835-31fc-4d43-b371-62bf82abd38d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:18.429516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba3563-f359-41e4-9ca9-4ab8de255cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:18.430762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba3563-f359-41e4-9ca9-4ab8de255cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:18.431289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba3563-f359-41e4-9ca9-4ab8de255cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:18.432207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba3563-f359-41e4-9ca9-4ab8de255cd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:18.446179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078dc2-3409-4535-a061-2727e0a5b142 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:18.447761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba3563-f359-41e4-9ca9-4ab8de255cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:18.449575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba3563-f359-41e4-9ca9-4ab8de255cd1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-77ba3563-f359-41e4-9ca9-4ab8de255cd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:18.475660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:18.476615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:18.477534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:18.477534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:18.477534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:18.477534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:18.477534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:18.477534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:18.477534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:18.477534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:18.480076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 377/748] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:18.486256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fe9f1-854e-444d-bb93-2a440d105510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:18.487066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fe9f1-854e-444d-bb93-2a440d105510 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:18.487347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fe9f1-854e-444d-bb93-2a440d105510 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:18.487618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fe9f1-854e-444d-bb93-2a440d105510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:18.495255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fe9f1-854e-444d-bb93-2a440d105510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:18.496786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fe9f1-854e-444d-bb93-2a440d105510 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:18.499644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba3563-f359-41e4-9ca9-4ab8de255cd1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c19fe9f1-854e-444d-bb93-2a440d105510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:18.513892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:18.514956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:18.515845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:18.515845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:18.515845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:18.515845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:18.515845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:18.515845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:18.515845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:18.515845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:18.522037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 372/749] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:18.522037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fe9f1-854e-444d-bb93-2a440d105510 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:18.625848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fe9f1-854e-444d-bb93-2a440d105510 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:18.660177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f2871-0efc-4641-b297-c0a4c7cc2c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:18.660756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f2871-0efc-4641-b297-c0a4c7cc2c40 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:18.661085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f2871-0efc-4641-b297-c0a4c7cc2c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:18.661366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f2871-0efc-4641-b297-c0a4c7cc2c40 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:18.662182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f2871-0efc-4641-b297-c0a4c7cc2c40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:18.662494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f2871-0efc-4641-b297-c0a4c7cc2c40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:18.663988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f2871-0efc-4641-b297-c0a4c7cc2c40 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:18.681513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 373/750] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:18.682762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f2871-0efc-4641-b297-c0a4c7cc2c40 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:18.757561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba3563-f359-41e4-9ca9-4ab8de255cd1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:18.781929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f2871-0efc-4641-b297-c0a4c7cc2c40 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:18.823980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4568f0a-30c6-4ac6-bb5f-909c7284a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:18.823980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568f0a-30c6-4ac6-bb5f-909c7284a369 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:18.823980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568f0a-30c6-4ac6-bb5f-909c7284a369 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:18.823980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568f0a-30c6-4ac6-bb5f-909c7284a369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:18.824412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568f0a-30c6-4ac6-bb5f-909c7284a369 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=db2c811cad8a490891834991a6101984) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:18.824412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568f0a-30c6-4ac6-bb5f-909c7284a369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:18.824412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568f0a-30c6-4ac6-bb5f-909c7284a369 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:18.835404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 374/751] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:18 2022] GET /identity/v3/role_assignments?user.id=db2c811cad8a490891834991a6101984&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=cb77715547a14bae950f68513af00d30 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:18.838130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed99d61-0db1-48dc-852c-790c47575afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:18.839194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed99d61-0db1-48dc-852c-790c47575afd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:18.839600 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed99d61-0db1-48dc-852c-790c47575afd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:18.840004 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed99d61-0db1-48dc-852c-790c47575afd None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:18.841383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed99d61-0db1-48dc-852c-790c47575afd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:18.841698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed99d61-0db1-48dc-852c-790c47575afd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:18.843771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed99d61-0db1-48dc-852c-790c47575afd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:18.860036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 378/752] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:18.865681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4568f0a-30c6-4ac6-bb5f-909c7284a369 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:19.021361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4568f0a-30c6-4ac6-bb5f-909c7284a369 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:19.062370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb51af2-acd1-4ed1-b50a-c0ab3c96d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:19.063431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb51af2-acd1-4ed1-b50a-c0ab3c96d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:19.063956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb51af2-acd1-4ed1-b50a-c0ab3c96d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:19.064444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb51af2-acd1-4ed1-b50a-c0ab3c96d1e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:19.065685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb51af2-acd1-4ed1-b50a-c0ab3c96d1e6 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=ad2ea98f75654ec8882650e686135aab) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:19.066233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb51af2-acd1-4ed1-b50a-c0ab3c96d1e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:19.067914 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb51af2-acd1-4ed1-b50a-c0ab3c96d1e6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:19.074625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 375/753] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:18 2022] GET /identity/v3/role_assignments?user.id=ad2ea98f75654ec8882650e686135aab&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:19.790595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0e22-5fdf-4e6c-a178-5df241ba6fed None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:19.791132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0e22-5fdf-4e6c-a178-5df241ba6fed None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:19.791132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0e22-5fdf-4e6c-a178-5df241ba6fed None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:19.792696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 379/754] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:19.798084 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b410-5ea1-40e1-abf4-d01651870e9b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:19.798894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b410-5ea1-40e1-abf4-d01651870e9b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:19.799394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b410-5ea1-40e1-abf4-d01651870e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:19.822949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7878b410-5ea1-40e1-abf4-d01651870e9b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:19.824639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7878b410-5ea1-40e1-abf4-d01651870e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:19.833247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511a80-786c-40b4-a8ac-e28ed44da4a2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:19.833529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511a80-786c-40b4-a8ac-e28ed44da4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:19.833806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511a80-786c-40b4-a8ac-e28ed44da4a2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:19.835387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 380/755] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:19.840309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c55a-e764-4e1b-b7d9-1e8a408564e9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:19.840668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c55a-e764-4e1b-b7d9-1e8a408564e9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:19.840921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c55a-e764-4e1b-b7d9-1e8a408564e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:19.866275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7885c55a-e764-4e1b-b7d9-1e8a408564e9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:19.867449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7885c55a-e764-4e1b-b7d9-1e8a408564e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:19.942304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 376/756] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:19.978401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b410-5ea1-40e1-abf4-d01651870e9b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:19.983974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 381/757] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:20.021033 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885c55a-e764-4e1b-b7d9-1e8a408564e9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:20.133110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b410-5ea1-40e1-abf4-d01651870e9b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:20.196521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885c55a-e764-4e1b-b7d9-1e8a408564e9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:20.207676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f383aa-9556-4908-81e3-f747ebc7c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:20.208485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f383aa-9556-4908-81e3-f747ebc7c675 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:20.208761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f383aa-9556-4908-81e3-f747ebc7c675 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:20.209028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f383aa-9556-4908-81e3-f747ebc7c675 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:20.209677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f383aa-9556-4908-81e3-f747ebc7c675 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:20.211053 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f383aa-9556-4908-81e3-f747ebc7c675 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a8f383aa-9556-4908-81e3-f747ebc7c675 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:20.230325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:20.231307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 15:29:20.232152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:20.235182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 377/758] 10.222.0.75 () {56 vars in 1129 bytes} [Tue May 17 15:29:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:20.241704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f383aa-9556-4908-81e3-f747ebc7c675 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:20.292557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732afbe3-0f83-4f1d-8052-5db8c19a1e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:20.292557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732afbe3-0f83-4f1d-8052-5db8c19a1e7d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:20.292557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732afbe3-0f83-4f1d-8052-5db8c19a1e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:20.292557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732afbe3-0f83-4f1d-8052-5db8c19a1e7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:20.302233 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732afbe3-0f83-4f1d-8052-5db8c19a1e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-732afbe3-0f83-4f1d-8052-5db8c19a1e7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:20.309779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:20.310736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:20.312137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 382/759] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:20.317379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732afbe3-0f83-4f1d-8052-5db8c19a1e7d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:20.397246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f383aa-9556-4908-81e3-f747ebc7c675 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:20.457458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732afbe3-0f83-4f1d-8052-5db8c19a1e7d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:20.458769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b628b6-d74d-4f2f-86c3-8fc2cddd5dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:20.459454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b628b6-d74d-4f2f-86c3-8fc2cddd5dbe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:20.459736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b628b6-d74d-4f2f-86c3-8fc2cddd5dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:20.460012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b628b6-d74d-4f2f-86c3-8fc2cddd5dbe None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:20.460742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b628b6-d74d-4f2f-86c3-8fc2cddd5dbe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:20.461051 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b628b6-d74d-4f2f-86c3-8fc2cddd5dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:20.462495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b628b6-d74d-4f2f-86c3-8fc2cddd5dbe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:20.468011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 378/760] 10.222.0.75 () {56 vars in 1124 bytes} [Tue May 17 15:29:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:20.474713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b628b6-d74d-4f2f-86c3-8fc2cddd5dbe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:20.533815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e440-648e-48dc-92e9-d40e9649ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:20.533815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e440-648e-48dc-92e9-d40e9649ef72 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:20.533815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e440-648e-48dc-92e9-d40e9649ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:20.533815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e440-648e-48dc-92e9-d40e9649ef72 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:20.534255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e440-648e-48dc-92e9-d40e9649ef72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:20.534255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e440-648e-48dc-92e9-d40e9649ef72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:20.534255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e440-648e-48dc-92e9-d40e9649ef72 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:20.562853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 383/761] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:20.572092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e440-648e-48dc-92e9-d40e9649ef72 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:20.694800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b628b6-d74d-4f2f-86c3-8fc2cddd5dbe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:20.773635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e440-648e-48dc-92e9-d40e9649ef72 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:20.774733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c706b4d-db83-4f48-85d5-4c103b822226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:20.775404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c706b4d-db83-4f48-85d5-4c103b822226 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:20.775685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c706b4d-db83-4f48-85d5-4c103b822226 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:20.775961 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c706b4d-db83-4f48-85d5-4c103b822226 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:20.776673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c706b4d-db83-4f48-85d5-4c103b822226 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:20.776982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c706b4d-db83-4f48-85d5-4c103b822226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:20.778388 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c706b4d-db83-4f48-85d5-4c103b822226 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:20.791819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 379/762] 10.222.0.75 () {56 vars in 1124 bytes} [Tue May 17 15:29:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:20.792709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c706b4d-db83-4f48-85d5-4c103b822226 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:20.841708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043b43c-5762-4ae7-8cbe-10daf05db2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:20.843476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043b43c-5762-4ae7-8cbe-10daf05db2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:20.843778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043b43c-5762-4ae7-8cbe-10daf05db2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:20.844982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043b43c-5762-4ae7-8cbe-10daf05db2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:20.864710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043b43c-5762-4ae7-8cbe-10daf05db2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:20.867372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043b43c-5762-4ae7-8cbe-10daf05db2a6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6043b43c-5762-4ae7-8cbe-10daf05db2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:20.899154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:20.900122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:20.900991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:20.900991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:20.900991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:20.900991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:20.906422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 384/763] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:20.909582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858f5ae-6144-4bdf-ba96-f4cb172b7077 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:20.909872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858f5ae-6144-4bdf-ba96-f4cb172b7077 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:20.910176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858f5ae-6144-4bdf-ba96-f4cb172b7077 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:20.911610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 385/764] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:20.914929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858f5ae-6144-4bdf-ba96-f4cb172b7077 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:20.981554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c706b4d-db83-4f48-85d5-4c103b822226 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:21.019963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c64d5e-31e0-4306-868a-0015572ce95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:21.020701 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64d5e-31e0-4306-868a-0015572ce95d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.020982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64d5e-31e0-4306-868a-0015572ce95d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.021255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64d5e-31e0-4306-868a-0015572ce95d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.022111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c64d5e-31e0-4306-868a-0015572ce95d None admin] RBAC: Adding query filter params (interface=public, service_id=32bde1d8405147549e2c7415822ddc96, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:21.022421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c64d5e-31e0-4306-868a-0015572ce95d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:21.024008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c64d5e-31e0-4306-868a-0015572ce95d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:21.046283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 380/765] 10.222.0.75 () {56 vars in 1251 bytes} [Tue May 17 15:29:20 2022] GET /identity/v3/endpoints?service_id=32bde1d8405147549e2c7415822ddc96&interface=public®ion_id=RegionOne => generated 194 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:21.046283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce3354-f82a-441f-a306-2a38d35011c5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.046283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce3354-f82a-441f-a306-2a38d35011c5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.046283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce3354-f82a-441f-a306-2a38d35011c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.073098 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ffce3354-f82a-441f-a306-2a38d35011c5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:21.075107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ffce3354-f82a-441f-a306-2a38d35011c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:21.132822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858f5ae-6144-4bdf-ba96-f4cb172b7077 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:21.151067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 381/766] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:21.152868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce3354-f82a-441f-a306-2a38d35011c5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:21.176237 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e4262-074a-4510-96c4-99958b66d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:21.176958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e4262-074a-4510-96c4-99958b66d422 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.177239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e4262-074a-4510-96c4-99958b66d422 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.177510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e4262-074a-4510-96c4-99958b66d422 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.178313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e4262-074a-4510-96c4-99958b66d422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:21.178618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e4262-074a-4510-96c4-99958b66d422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:21.180152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e4262-074a-4510-96c4-99958b66d422 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:21.194281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 386/767] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:21.195220 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e4262-074a-4510-96c4-99958b66d422 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:21.277301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce3354-f82a-441f-a306-2a38d35011c5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:21.304477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e4262-074a-4510-96c4-99958b66d422 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:21.311445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8207d-3e72-43ab-b887-79583c7529e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:21.312154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8207d-3e72-43ab-b887-79583c7529e8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.312430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8207d-3e72-43ab-b887-79583c7529e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.312699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8207d-3e72-43ab-b887-79583c7529e8 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.313383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8207d-3e72-43ab-b887-79583c7529e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:21.314764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8207d-3e72-43ab-b887-79583c7529e8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:21.326241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 382/768] 10.222.0.75 () {56 vars in 1087 bytes} [Tue May 17 15:29:21 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:21.326241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8207d-3e72-43ab-b887-79583c7529e8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:21.376120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56161de-1a98-4564-bcef-00f3e5e4f085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:21.378538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56161de-1a98-4564-bcef-00f3e5e4f085 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.379720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56161de-1a98-4564-bcef-00f3e5e4f085 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.380148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56161de-1a98-4564-bcef-00f3e5e4f085 None admin] PATH_INFO: `/v3/services/network` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.380951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56161de-1a98-4564-bcef-00f3e5e4f085 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:21.387389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56161de-1a98-4564-bcef-00f3e5e4f085 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c56161de-1a98-4564-bcef-00f3e5e4f085 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:21.403769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:21.405098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 15:29:21.405969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:21.416963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 387/769] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:21 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:21.419637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56161de-1a98-4564-bcef-00f3e5e4f085 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:21.513776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8207d-3e72-43ab-b887-79583c7529e8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:21.553634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07334165-dd4f-4b28-9f3f-d1f64b6d20a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:21.554843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07334165-dd4f-4b28-9f3f-d1f64b6d20a5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.555354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07334165-dd4f-4b28-9f3f-d1f64b6d20a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.555881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07334165-dd4f-4b28-9f3f-d1f64b6d20a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.564341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07334165-dd4f-4b28-9f3f-d1f64b6d20a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:21.566160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07334165-dd4f-4b28-9f3f-d1f64b6d20a5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-07334165-dd4f-4b28-9f3f-d1f64b6d20a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:21.581755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:21.582794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:21.583751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:21.586439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 383/770] 10.222.0.75 () {56 vars in 1093 bytes} [Tue May 17 15:29:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:21.592736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07334165-dd4f-4b28-9f3f-d1f64b6d20a5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:21.600057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56161de-1a98-4564-bcef-00f3e5e4f085 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:21.648109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77ca3f-52cc-4ea7-984d-110b18fc5659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:21.649586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77ca3f-52cc-4ea7-984d-110b18fc5659 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.650149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77ca3f-52cc-4ea7-984d-110b18fc5659 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.650630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77ca3f-52cc-4ea7-984d-110b18fc5659 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.651913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77ca3f-52cc-4ea7-984d-110b18fc5659 None admin] RBAC: Adding query filter params (name=network) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:21.652713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77ca3f-52cc-4ea7-984d-110b18fc5659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:21.655279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77ca3f-52cc-4ea7-984d-110b18fc5659 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:21.662230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 388/771] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:21.668029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77ca3f-52cc-4ea7-984d-110b18fc5659 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:21.720461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07334165-dd4f-4b28-9f3f-d1f64b6d20a5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:21.760634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e9ca6-8585-4320-aba8-a0338bc0bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:21.761300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9ca6-8585-4320-aba8-a0338bc0bd33 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.761579 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9ca6-8585-4320-aba8-a0338bc0bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.761850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9ca6-8585-4320-aba8-a0338bc0bd33 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.762893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9ca6-8585-4320-aba8-a0338bc0bd33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:21.763197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9ca6-8585-4320-aba8-a0338bc0bd33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:21.764974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9ca6-8585-4320-aba8-a0338bc0bd33 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:21.780997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77ca3f-52cc-4ea7-984d-110b18fc5659 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:21.790082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 384/772] 10.222.0.75 () {56 vars in 1133 bytes} [Tue May 17 15:29:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:21.791736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e6533-ac9f-42a8-b554-a771f397fdd2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.793895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e6533-ac9f-42a8-b554-a771f397fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.794378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e6533-ac9f-42a8-b554-a771f397fdd2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.796808 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 385/773] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:21.797781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e6533-ac9f-42a8-b554-a771f397fdd2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:21.822406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84af99e-29ea-4479-adb5-628ea0e31732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:21.823381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af99e-29ea-4479-adb5-628ea0e31732 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.823842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af99e-29ea-4479-adb5-628ea0e31732 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.824449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af99e-29ea-4479-adb5-628ea0e31732 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.825352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84af99e-29ea-4479-adb5-628ea0e31732 None admin] RBAC: Adding query filter params (type=network) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:21.825768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84af99e-29ea-4479-adb5-628ea0e31732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:21.827943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84af99e-29ea-4479-adb5-628ea0e31732 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:21.836978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 389/774] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:21.836978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad597b6-27df-4991-bb21-5f8d52e7a14d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.836978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad597b6-27df-4991-bb21-5f8d52e7a14d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.836978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad597b6-27df-4991-bb21-5f8d52e7a14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.853382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2ad597b6-27df-4991-bb21-5f8d52e7a14d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:21.854657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2ad597b6-27df-4991-bb21-5f8d52e7a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:21.906492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e6533-ac9f-42a8-b554-a771f397fdd2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:21.921160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 390/775] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:21.922734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6f20-18c6-48b5-bb37-c03d111ae597 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.923018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6f20-18c6-48b5-bb37-c03d111ae597 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.923293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6f20-18c6-48b5-bb37-c03d111ae597 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.924682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 391/776] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:21.925181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6f20-18c6-48b5-bb37-c03d111ae597 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:21.950894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987e90d-f95c-4fe2-8ff4-2686dfff6cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:21.952231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e90d-f95c-4fe2-8ff4-2686dfff6cff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.952515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e90d-f95c-4fe2-8ff4-2686dfff6cff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.952789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e90d-f95c-4fe2-8ff4-2686dfff6cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:21.963143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987e90d-f95c-4fe2-8ff4-2686dfff6cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:21.964583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987e90d-f95c-4fe2-8ff4-2686dfff6cff None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f987e90d-f95c-4fe2-8ff4-2686dfff6cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:21.982759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:21.984108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:21.984996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:21.984996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:21.984996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:21.984996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:21.984996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 386/777] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:21.985273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44582-47ad-4b5b-a429-bd16cdedeb4a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:21.985627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44582-47ad-4b5b-a429-bd16cdedeb4a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:21.985714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44582-47ad-4b5b-a429-bd16cdedeb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.003111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6bb44582-47ad-4b5b-a429-bd16cdedeb4a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:22.004285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6bb44582-47ad-4b5b-a429-bd16cdedeb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:22.037304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6f20-18c6-48b5-bb37-c03d111ae597 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.071138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdead8-dfd3-4f0c-85cc-e4406c2ae975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.071792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdead8-dfd3-4f0c-85cc-e4406c2ae975 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.072070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdead8-dfd3-4f0c-85cc-e4406c2ae975 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.072342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdead8-dfd3-4f0c-85cc-e4406c2ae975 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.073173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdead8-dfd3-4f0c-85cc-e4406c2ae975 None admin] RBAC: Adding query filter params (interface=public, service_id=2ad7f3c7114e45bbb06de57700447773, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:22.073434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdead8-dfd3-4f0c-85cc-e4406c2ae975 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:22.074298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 387/778] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:22.074896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdead8-dfd3-4f0c-85cc-e4406c2ae975 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:22.075597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44582-47ad-4b5b-a429-bd16cdedeb4a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.083708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 392/779] 10.222.0.75 () {56 vars in 1251 bytes} [Tue May 17 15:29:21 2022] GET /identity/v3/endpoints?service_id=2ad7f3c7114e45bbb06de57700447773&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:22.084568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdead8-dfd3-4f0c-85cc-e4406c2ae975 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.178024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44582-47ad-4b5b-a429-bd16cdedeb4a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.189238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdead8-dfd3-4f0c-85cc-e4406c2ae975 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.211815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da785e-db1c-4617-b73a-a4b2c2bb0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.212601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da785e-db1c-4617-b73a-a4b2c2bb0600 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.212885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da785e-db1c-4617-b73a-a4b2c2bb0600 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.213153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da785e-db1c-4617-b73a-a4b2c2bb0600 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.223146 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da785e-db1c-4617-b73a-a4b2c2bb0600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:22.223395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7944-de4d-4a54-9643-3ae0b150e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.224004 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7944-de4d-4a54-9643-3ae0b150e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.224285 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7944-de4d-4a54-9643-3ae0b150e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.224557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7944-de4d-4a54-9643-3ae0b150e0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.225275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb7944-de4d-4a54-9643-3ae0b150e0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:22.225576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb7944-de4d-4a54-9643-3ae0b150e0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:22.226986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb7944-de4d-4a54-9643-3ae0b150e0f3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b9da785e-db1c-4617-b73a-a4b2c2bb0600 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:22.233497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:22.234505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 388/780] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:22.235377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da785e-db1c-4617-b73a-a4b2c2bb0600 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.246245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 393/781] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:22.246245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7944-de4d-4a54-9643-3ae0b150e0f3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.334855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da785e-db1c-4617-b73a-a4b2c2bb0600 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.353220 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7944-de4d-4a54-9643-3ae0b150e0f3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.366676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2285-0843-467a-9dd3-df666ef51bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.367350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2285-0843-467a-9dd3-df666ef51bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.367630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2285-0843-467a-9dd3-df666ef51bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.367903 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2285-0843-467a-9dd3-df666ef51bf0 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.368595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2285-0843-467a-9dd3-df666ef51bf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:22.369984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2285-0843-467a-9dd3-df666ef51bf0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:22.383325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 389/782] 10.222.0.75 () {56 vars in 1087 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/services => generated 772 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:22.383325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2285-0843-467a-9dd3-df666ef51bf0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.494691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2285-0843-467a-9dd3-df666ef51bf0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.518679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2e82f-6606-479d-a3bc-5d7fd10564dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.519653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2e82f-6606-479d-a3bc-5d7fd10564dc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.520280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2e82f-6606-479d-a3bc-5d7fd10564dc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.520562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2e82f-6606-479d-a3bc-5d7fd10564dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.530296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994707f-9cfd-4f60-967b-ee4d677d30cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.531045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994707f-9cfd-4f60-967b-ee4d677d30cb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.531322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994707f-9cfd-4f60-967b-ee4d677d30cb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.531593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994707f-9cfd-4f60-967b-ee4d677d30cb None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.532337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994707f-9cfd-4f60-967b-ee4d677d30cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:22.532636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994707f-9cfd-4f60-967b-ee4d677d30cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:22.533708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2e82f-6606-479d-a3bc-5d7fd10564dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:22.534014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994707f-9cfd-4f60-967b-ee4d677d30cb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:22.543034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 390/783] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e4d2e82f-6606-479d-a3bc-5d7fd10564dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:22.543287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:22.544227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:22.545083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:22.547291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994707f-9cfd-4f60-967b-ee4d677d30cb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.547447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 394/784] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:22.553166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2e82f-6606-479d-a3bc-5d7fd10564dc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.661574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994707f-9cfd-4f60-967b-ee4d677d30cb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.683685 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2e82f-6606-479d-a3bc-5d7fd10564dc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.697030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c819c0e-9515-4308-bf95-94e7eea49972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.697822 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c819c0e-9515-4308-bf95-94e7eea49972 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.698142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c819c0e-9515-4308-bf95-94e7eea49972 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.698415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c819c0e-9515-4308-bf95-94e7eea49972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.705319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c819c0e-9515-4308-bf95-94e7eea49972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:22.706871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c819c0e-9515-4308-bf95-94e7eea49972 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2c819c0e-9515-4308-bf95-94e7eea49972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:22.721349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:22.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:22.723555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:22.723555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:22.723555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:22.723555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:22.723555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:22.723555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:22.723555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:22.723555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:22.723555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 391/785] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:22.724062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c819c0e-9515-4308-bf95-94e7eea49972 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.726964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84890-6956-40c1-a0e8-9aa392866086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.727793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84890-6956-40c1-a0e8-9aa392866086 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.728215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84890-6956-40c1-a0e8-9aa392866086 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.728637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84890-6956-40c1-a0e8-9aa392866086 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.729520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84890-6956-40c1-a0e8-9aa392866086 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:22.729966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84890-6956-40c1-a0e8-9aa392866086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:22.733230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84890-6956-40c1-a0e8-9aa392866086 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:22.743958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 395/786] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:22.749214 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84890-6956-40c1-a0e8-9aa392866086 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.830954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c819c0e-9515-4308-bf95-94e7eea49972 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.866460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a874dc7-865e-45fc-8341-05320bf84288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.867229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a874dc7-865e-45fc-8341-05320bf84288 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.867505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a874dc7-865e-45fc-8341-05320bf84288 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.867776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a874dc7-865e-45fc-8341-05320bf84288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.872230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84890-6956-40c1-a0e8-9aa392866086 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:22.878399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a874dc7-865e-45fc-8341-05320bf84288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:22.879824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a874dc7-865e-45fc-8341-05320bf84288 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6a874dc7-865e-45fc-8341-05320bf84288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:22.897143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:22.898286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:22.899293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:22.899293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:22.899293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:22.899293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:22.899293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 392/787] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:22.899741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a874dc7-865e-45fc-8341-05320bf84288 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:22.913863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bc899-8ae6-41af-b310-132c2221e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:22.915129 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bc899-8ae6-41af-b310-132c2221e628 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:22.915794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bc899-8ae6-41af-b310-132c2221e628 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:22.916213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bc899-8ae6-41af-b310-132c2221e628 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:22.917310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bc899-8ae6-41af-b310-132c2221e628 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:22.918154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bc899-8ae6-41af-b310-132c2221e628 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:22.919716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bc899-8ae6-41af-b310-132c2221e628 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:22.937010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 396/788] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:22.938088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bc899-8ae6-41af-b310-132c2221e628 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.001326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a874dc7-865e-45fc-8341-05320bf84288 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.035521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4b8b-1097-4fb6-ad25-9388c42ed173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.036453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4b8b-1097-4fb6-ad25-9388c42ed173 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.036837 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4b8b-1097-4fb6-ad25-9388c42ed173 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.037218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4b8b-1097-4fb6-ad25-9388c42ed173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.047882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c4b8b-1097-4fb6-ad25-9388c42ed173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.049441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c4b8b-1097-4fb6-ad25-9388c42ed173 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.062842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bc899-8ae6-41af-b310-132c2221e628 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2b9c4b8b-1097-4fb6-ad25-9388c42ed173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:23.068165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:23.069194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:23.070308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:23.070308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:23.070308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:23.070308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:23.076425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 393/789] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:23.077466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4b8b-1097-4fb6-ad25-9388c42ed173 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.105319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb6f5d-a959-4a27-9440-cb2871a90083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.106441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb6f5d-a959-4a27-9440-cb2871a90083 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.106845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb6f5d-a959-4a27-9440-cb2871a90083 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.107220 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb6f5d-a959-4a27-9440-cb2871a90083 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.108756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb6f5d-a959-4a27-9440-cb2871a90083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:23.109473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb6f5d-a959-4a27-9440-cb2871a90083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.111111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb6f5d-a959-4a27-9440-cb2871a90083 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.129455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 397/790] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:23.129455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb6f5d-a959-4a27-9440-cb2871a90083 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.204687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4b8b-1097-4fb6-ad25-9388c42ed173 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.227855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb6f5d-a959-4a27-9440-cb2871a90083 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.249170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df75ec-ea2a-4387-a3f4-bdabd6b0a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.250236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df75ec-ea2a-4387-a3f4-bdabd6b0a7a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.250868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df75ec-ea2a-4387-a3f4-bdabd6b0a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.251223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df75ec-ea2a-4387-a3f4-bdabd6b0a7a5 None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8ef90c1c9c784d8792b3afe6e8e7fb31/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.253920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df75ec-ea2a-4387-a3f4-bdabd6b0a7a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=8ef90c1c9c784d8792b3afe6e8e7fb31, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.255814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df75ec-ea2a-4387-a3f4-bdabd6b0a7a5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.264742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3c07e-9215-464b-b45d-89cf640db12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.265723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3c07e-9215-464b-b45d-89cf640db12e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.266213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3c07e-9215-464b-b45d-89cf640db12e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.266722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3c07e-9215-464b-b45d-89cf640db12e None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.267617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3c07e-9215-464b-b45d-89cf640db12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:23.268169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3c07e-9215-464b-b45d-89cf640db12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.269786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3c07e-9215-464b-b45d-89cf640db12e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.273390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 394/791] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:29:23 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8ef90c1c9c784d8792b3afe6e8e7fb31/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:29:23.274392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df75ec-ea2a-4387-a3f4-bdabd6b0a7a5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.289555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 398/792] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:23.291097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3c07e-9215-464b-b45d-89cf640db12e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.401277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df75ec-ea2a-4387-a3f4-bdabd6b0a7a5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.407384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3c07e-9215-464b-b45d-89cf640db12e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.436936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264a115-ea0d-48c5-9939-bacdff4edb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.438144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264a115-ea0d-48c5-9939-bacdff4edb00 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.438676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264a115-ea0d-48c5-9939-bacdff4edb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.439170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264a115-ea0d-48c5-9939-bacdff4edb00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.447079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264a115-ea0d-48c5-9939-bacdff4edb00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.448860 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264a115-ea0d-48c5-9939-bacdff4edb00 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.450383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2659028-13b7-42f9-b814-5c93c0767bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.451213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2659028-13b7-42f9-b814-5c93c0767bec None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.451739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2659028-13b7-42f9-b814-5c93c0767bec None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.452016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2659028-13b7-42f9-b814-5c93c0767bec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.460436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2659028-13b7-42f9-b814-5c93c0767bec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.461829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2659028-13b7-42f9-b814-5c93c0767bec None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b264a115-ea0d-48c5-9939-bacdff4edb00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:23.465760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:23.466754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:23.467840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:23.470577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 395/793] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:23.484221 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264a115-ea0d-48c5-9939-bacdff4edb00 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f2659028-13b7-42f9-b814-5c93c0767bec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:23.484438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:23.485373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:23.486359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 399/794] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:29:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:23.492844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2659028-13b7-42f9-b814-5c93c0767bec None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.626219 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264a115-ea0d-48c5-9939-bacdff4edb00 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.660116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2659028-13b7-42f9-b814-5c93c0767bec None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.671255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1776c89-1822-458d-a9af-7a08e3712b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.672246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776c89-1822-458d-a9af-7a08e3712b97 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.672726 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776c89-1822-458d-a9af-7a08e3712b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.673194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776c89-1822-458d-a9af-7a08e3712b97 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.674313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1776c89-1822-458d-a9af-7a08e3712b97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:23.674840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1776c89-1822-458d-a9af-7a08e3712b97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.679517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1776c89-1822-458d-a9af-7a08e3712b97 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.697958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91951e50-fae1-44bd-927e-7904f4dd75a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.698800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91951e50-fae1-44bd-927e-7904f4dd75a5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.699088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91951e50-fae1-44bd-927e-7904f4dd75a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.699365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91951e50-fae1-44bd-927e-7904f4dd75a5 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.700263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91951e50-fae1-44bd-927e-7904f4dd75a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:23.700576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91951e50-fae1-44bd-927e-7904f4dd75a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.702252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91951e50-fae1-44bd-927e-7904f4dd75a5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.718290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 396/795] 10.222.0.75 () {56 vars in 1135 bytes} [Tue May 17 15:29:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:23.727423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 400/796] 10.222.0.75 () {56 vars in 1149 bytes} [Tue May 17 15:29:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:23.729371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1776c89-1822-458d-a9af-7a08e3712b97 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.738886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91951e50-fae1-44bd-927e-7904f4dd75a5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.837907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1776c89-1822-458d-a9af-7a08e3712b97 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.854890 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91951e50-fae1-44bd-927e-7904f4dd75a5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:23.873082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8d360-42e5-4f84-b213-27051631adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.874276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8d360-42e5-4f84-b213-27051631adaf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.874753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8d360-42e5-4f84-b213-27051631adaf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.875238 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8d360-42e5-4f84-b213-27051631adaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.885718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8d360-42e5-4f84-b213-27051631adaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.887444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8d360-42e5-4f84-b213-27051631adaf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.893855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2481f-f558-4671-917b-46c48a2faff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:23.894677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2481f-f558-4671-917b-46c48a2faff0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.894957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2481f-f558-4671-917b-46c48a2faff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.895644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2481f-f558-4671-917b-46c48a2faff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-25d8d360-42e5-4f84-b213-27051631adaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:23.906661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:23.907631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:23.908525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:23.908525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:23.908525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:23.908525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:23.908754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2481f-f558-4671-917b-46c48a2faff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:23.908754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2481f-f558-4671-917b-46c48a2faff0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:23.910917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 397/797] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:23.912359 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca8c4-700a-4bba-9ce2-79f4f83e715c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.912834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca8c4-700a-4bba-9ce2-79f4f83e715c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.913305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca8c4-700a-4bba-9ce2-79f4f83e715c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.915066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 398/798] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:23.919963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca8c4-700a-4bba-9ce2-79f4f83e715c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c8e2481f-f558-4671-917b-46c48a2faff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:23.932207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:23.933265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:23.934411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:23.934411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:23.934411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:23.934411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:23.937084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 401/799] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:23.938605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe42ef6-e261-4aad-942e-1bedae97a599 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:23.939021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe42ef6-e261-4aad-942e-1bedae97a599 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:23.939424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe42ef6-e261-4aad-942e-1bedae97a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:23.960731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6fe42ef6-e261-4aad-942e-1bedae97a599 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:23.962675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6fe42ef6-e261-4aad-942e-1bedae97a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:24.044111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca8c4-700a-4bba-9ce2-79f4f83e715c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.057718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 402/800] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:24.057718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe42ef6-e261-4aad-942e-1bedae97a599 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.096541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b60d3-de45-467d-a40d-f10f7305661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.097364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b60d3-de45-467d-a40d-f10f7305661e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.097873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b60d3-de45-467d-a40d-f10f7305661e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.098274 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b60d3-de45-467d-a40d-f10f7305661e None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.099411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b60d3-de45-467d-a40d-f10f7305661e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:24.100075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b60d3-de45-467d-a40d-f10f7305661e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.101745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b60d3-de45-467d-a40d-f10f7305661e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.115457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 399/801] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:24.116834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b60d3-de45-467d-a40d-f10f7305661e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.174199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe42ef6-e261-4aad-942e-1bedae97a599 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.208425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec9abb-621e-46f6-b624-9aca58c74392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.209090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec9abb-621e-46f6-b624-9aca58c74392 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.209371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec9abb-621e-46f6-b624-9aca58c74392 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.209644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec9abb-621e-46f6-b624-9aca58c74392 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.210393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec9abb-621e-46f6-b624-9aca58c74392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:24.210696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec9abb-621e-46f6-b624-9aca58c74392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.212066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec9abb-621e-46f6-b624-9aca58c74392 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.228588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 403/802] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:24.228588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec9abb-621e-46f6-b624-9aca58c74392 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.253520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b60d3-de45-467d-a40d-f10f7305661e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.298883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f60ae-b1d2-4ab8-82ff-b9e8ede49959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.299937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f60ae-b1d2-4ab8-82ff-b9e8ede49959 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.300363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f60ae-b1d2-4ab8-82ff-b9e8ede49959 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.300776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f60ae-b1d2-4ab8-82ff-b9e8ede49959 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.301572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f60ae-b1d2-4ab8-82ff-b9e8ede49959 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.303583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f60ae-b1d2-4ab8-82ff-b9e8ede49959 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c28f60ae-b1d2-4ab8-82ff-b9e8ede49959 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:24.320300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:24.321453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 15:29:24.322498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:24.325606 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 400/803] 10.222.0.75 () {56 vars in 1129 bytes} [Tue May 17 15:29:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:24.326590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f60ae-b1d2-4ab8-82ff-b9e8ede49959 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.335620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec9abb-621e-46f6-b624-9aca58c74392 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.376215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff24b2-ea6b-4678-930e-d99d0d2e71e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.377329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff24b2-ea6b-4678-930e-d99d0d2e71e3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.377817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff24b2-ea6b-4678-930e-d99d0d2e71e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.378254 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff24b2-ea6b-4678-930e-d99d0d2e71e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.388192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff24b2-ea6b-4678-930e-d99d0d2e71e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.390636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff24b2-ea6b-4678-930e-d99d0d2e71e3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-eeff24b2-ea6b-4678-930e-d99d0d2e71e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:24.409464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:24.410611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:24.411664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:24.411664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:24.411664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:24.411664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:24.411664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:24.411664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:24.411664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:24.411664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:24.414155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 404/804] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:24.415893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff24b2-ea6b-4678-930e-d99d0d2e71e3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.445907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f60ae-b1d2-4ab8-82ff-b9e8ede49959 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.479801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9decd-3e61-4cb9-85e6-9d7138990754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.480743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9decd-3e61-4cb9-85e6-9d7138990754 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.481132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9decd-3e61-4cb9-85e6-9d7138990754 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.481511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9decd-3e61-4cb9-85e6-9d7138990754 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.488738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9decd-3e61-4cb9-85e6-9d7138990754 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.490370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9decd-3e61-4cb9-85e6-9d7138990754 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b1c9decd-3e61-4cb9-85e6-9d7138990754 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:24.504329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:24.505367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:24.506393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:24.506393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:24.506393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:24.506393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:24.506393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:24.506393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:24.506393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:24.506393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:24.512565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 401/805] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:24.513504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9decd-3e61-4cb9-85e6-9d7138990754 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.539664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff24b2-ea6b-4678-930e-d99d0d2e71e3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.573993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68515674-42bd-421b-a5ac-18e2d2ec87e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.574584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68515674-42bd-421b-a5ac-18e2d2ec87e1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.574971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68515674-42bd-421b-a5ac-18e2d2ec87e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.575352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68515674-42bd-421b-a5ac-18e2d2ec87e1 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.576159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68515674-42bd-421b-a5ac-18e2d2ec87e1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:24.576595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68515674-42bd-421b-a5ac-18e2d2ec87e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.578188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68515674-42bd-421b-a5ac-18e2d2ec87e1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.587305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 405/806] 10.222.0.75 () {56 vars in 1124 bytes} [Tue May 17 15:29:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:24.588291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68515674-42bd-421b-a5ac-18e2d2ec87e1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.633593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9decd-3e61-4cb9-85e6-9d7138990754 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.674594 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118dcaa-6ea7-4a93-a855-0a61b794e873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.675495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118dcaa-6ea7-4a93-a855-0a61b794e873 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.675924 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118dcaa-6ea7-4a93-a855-0a61b794e873 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.676337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118dcaa-6ea7-4a93-a855-0a61b794e873 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.677293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118dcaa-6ea7-4a93-a855-0a61b794e873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:24.677726 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118dcaa-6ea7-4a93-a855-0a61b794e873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.679295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118dcaa-6ea7-4a93-a855-0a61b794e873 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.691688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 402/807] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:24.692723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118dcaa-6ea7-4a93-a855-0a61b794e873 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.697324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68515674-42bd-421b-a5ac-18e2d2ec87e1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.735488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a66231-6f40-4fad-a571-c4dbe4674faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.736389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a66231-6f40-4fad-a571-c4dbe4674faa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.737282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a66231-6f40-4fad-a571-c4dbe4674faa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.737282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a66231-6f40-4fad-a571-c4dbe4674faa None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.738068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a66231-6f40-4fad-a571-c4dbe4674faa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:24.738500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a66231-6f40-4fad-a571-c4dbe4674faa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.740128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a66231-6f40-4fad-a571-c4dbe4674faa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.753209 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 406/808] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:24.758839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a66231-6f40-4fad-a571-c4dbe4674faa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.798114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118dcaa-6ea7-4a93-a855-0a61b794e873 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.832115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598f083-c792-4fb7-ad9a-b4f23f5c5410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.832999 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f083-c792-4fb7-ad9a-b4f23f5c5410 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.833421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f083-c792-4fb7-ad9a-b4f23f5c5410 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.833834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f083-c792-4fb7-ad9a-b4f23f5c5410 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.834720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598f083-c792-4fb7-ad9a-b4f23f5c5410 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:24.835161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598f083-c792-4fb7-ad9a-b4f23f5c5410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.836637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598f083-c792-4fb7-ad9a-b4f23f5c5410 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.841849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 403/809] 10.222.0.75 () {56 vars in 1124 bytes} [Tue May 17 15:29:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:24.842797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598f083-c792-4fb7-ad9a-b4f23f5c5410 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.865850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a66231-6f40-4fad-a571-c4dbe4674faa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.902755 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b6bec-f27a-405b-9686-eca187331bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.903740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6bec-f27a-405b-9686-eca187331bef None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.904103 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6bec-f27a-405b-9686-eca187331bef None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.904513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6bec-f27a-405b-9686-eca187331bef None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/db2c811cad8a490891834991a6101984/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:24.906581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b6bec-f27a-405b-9686-eca187331bef None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=db2c811cad8a490891834991a6101984, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:24.908017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b6bec-f27a-405b-9686-eca187331bef None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:24.921521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 407/810] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:29:24 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/db2c811cad8a490891834991a6101984/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:29:24.922407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b6bec-f27a-405b-9686-eca187331bef None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:24.958710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598f083-c792-4fb7-ad9a-b4f23f5c5410 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:24.995675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7aff4-ef48-4874-8865-86ed9a6f4146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:24.996809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aff4-ef48-4874-8865-86ed9a6f4146 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:24.997233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aff4-ef48-4874-8865-86ed9a6f4146 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:24.997654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aff4-ef48-4874-8865-86ed9a6f4146 None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/ad2ea98f75654ec8882650e686135aab/roles/d07b4b63f6254b2da86b74c94166cb68` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.014574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7aff4-ef48-4874-8865-86ed9a6f4146 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=ad2ea98f75654ec8882650e686135aab, role_id=d07b4b63f6254b2da86b74c94166cb68)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:25.016315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7aff4-ef48-4874-8865-86ed9a6f4146 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:25.035817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 404/811] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:29:24 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/ad2ea98f75654ec8882650e686135aab/roles/d07b4b63f6254b2da86b74c94166cb68 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:29:25.037392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81113d96-f6f1-4663-9acd-ae1af5a6f4bd None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:25.037789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81113d96-f6f1-4663-9acd-ae1af5a6f4bd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:25.038195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81113d96-f6f1-4663-9acd-ae1af5a6f4bd None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.044187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 405/812] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:25.051788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52684334-6cb7-4202-99d8-72f9cb3b9f04 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:25.052496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52684334-6cb7-4202-99d8-72f9cb3b9f04 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:25.052917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52684334-6cb7-4202-99d8-72f9cb3b9f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.075730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b6bec-f27a-405b-9686-eca187331bef None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:25.090557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-52684334-6cb7-4202-99d8-72f9cb3b9f04 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:25.092100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-52684334-6cb7-4202-99d8-72f9cb3b9f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:25.133096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1847f-8827-449f-b2d9-a36bb8e714e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:25.134038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1847f-8827-449f-b2d9-a36bb8e714e1 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:25.134489 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1847f-8827-449f-b2d9-a36bb8e714e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:25.134905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1847f-8827-449f-b2d9-a36bb8e714e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.135786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1847f-8827-449f-b2d9-a36bb8e714e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:25.137337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1847f-8827-449f-b2d9-a36bb8e714e1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:25.168323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 408/813] 10.222.0.75 () {60 vars in 1144 bytes} [Tue May 17 15:29:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:25.214863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 406/814] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:25.245448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1847f-8827-449f-b2d9-a36bb8e714e1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:25.369511 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1847f-8827-449f-b2d9-a36bb8e714e1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:25.407371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdc790-c8ea-4104-be83-8b7ccb1f53f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:25.408164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdc790-c8ea-4104-be83-8b7ccb1f53f4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:25.408442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdc790-c8ea-4104-be83-8b7ccb1f53f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:25.408712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdc790-c8ea-4104-be83-8b7ccb1f53f4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.409352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdc790-c8ea-4104-be83-8b7ccb1f53f4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:25.410763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdc790-c8ea-4104-be83-8b7ccb1f53f4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-77cdc790-c8ea-4104-be83-8b7ccb1f53f4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:25.423247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:25.424227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:25.425058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 409/815] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:25 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:25.432863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52684334-6cb7-4202-99d8-72f9cb3b9f04 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:25.534041 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52684334-6cb7-4202-99d8-72f9cb3b9f04 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:25.569849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6b4e0-23ba-4c1f-b04e-f1f3e3cdaec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:25.570904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6b4e0-23ba-4c1f-b04e-f1f3e3cdaec1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:25.571470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6b4e0-23ba-4c1f-b04e-f1f3e3cdaec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:25.571951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6b4e0-23ba-4c1f-b04e-f1f3e3cdaec1 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.572868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6b4e0-23ba-4c1f-b04e-f1f3e3cdaec1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:25.573413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6b4e0-23ba-4c1f-b04e-f1f3e3cdaec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:25.575006 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6b4e0-23ba-4c1f-b04e-f1f3e3cdaec1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:25.580795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 407/816] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:25.585932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdc790-c8ea-4104-be83-8b7ccb1f53f4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:25.712330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdc790-c8ea-4104-be83-8b7ccb1f53f4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:25.757639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29346e06-8bd3-436d-8449-055f154e0939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:25.758691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29346e06-8bd3-436d-8449-055f154e0939 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:25.759216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29346e06-8bd3-436d-8449-055f154e0939 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:25.759696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29346e06-8bd3-436d-8449-055f154e0939 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.760662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29346e06-8bd3-436d-8449-055f154e0939 None admin] RBAC: Adding query filter params (type=network) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:25.761170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29346e06-8bd3-436d-8449-055f154e0939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:25.762798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29346e06-8bd3-436d-8449-055f154e0939 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:25.768903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 410/817] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:25.774990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6b4e0-23ba-4c1f-b04e-f1f3e3cdaec1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:25.888460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56abf-dcb1-4bf1-b38b-d320ae19f855 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:25.889771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56abf-dcb1-4bf1-b38b-d320ae19f855 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:25.890330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56abf-dcb1-4bf1-b38b-d320ae19f855 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.893548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 411/818] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:25.897420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01613133-013d-4817-a127-84e4be659763 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:25.897945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01613133-013d-4817-a127-84e4be659763 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:25.898483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01613133-013d-4817-a127-84e4be659763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.913378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6b4e0-23ba-4c1f-b04e-f1f3e3cdaec1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:25.930984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-01613133-013d-4817-a127-84e4be659763 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:25.932865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-01613133-013d-4817-a127-84e4be659763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:25.946935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96a792-db1a-45a8-bb84-e66250078b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:25.947673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a792-db1a-45a8-bb84-e66250078b3d None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:25.948019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a792-db1a-45a8-bb84-e66250078b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:25.948371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a792-db1a-45a8-bb84-e66250078b3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:25.949168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96a792-db1a-45a8-bb84-e66250078b3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:25.954034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96a792-db1a-45a8-bb84-e66250078b3d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:25.982085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 408/819] 10.222.0.75 () {60 vars in 1144 bytes} [Tue May 17 15:29:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:26.052871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 412/820] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:26.092486 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96a792-db1a-45a8-bb84-e66250078b3d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:26.214029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96a792-db1a-45a8-bb84-e66250078b3d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:26.247006 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1c7cc-31f4-4569-969d-fe70b52ecbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:26.247774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1c7cc-31f4-4569-969d-fe70b52ecbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:26.248053 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1c7cc-31f4-4569-969d-fe70b52ecbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:26.248835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1c7cc-31f4-4569-969d-fe70b52ecbb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:26.258848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1c7cc-31f4-4569-969d-fe70b52ecbb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-33f1c7cc-31f4-4569-969d-fe70b52ecbb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:26.267065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:26.268069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:26.269958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 409/821] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:26.274270 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01613133-013d-4817-a127-84e4be659763 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:26.377246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01613133-013d-4817-a127-84e4be659763 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:26.416829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da0095-9193-4386-9271-d0ff57c91c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:26.417526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da0095-9193-4386-9271-d0ff57c91c15 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:26.417806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da0095-9193-4386-9271-d0ff57c91c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:26.418114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da0095-9193-4386-9271-d0ff57c91c15 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:26.418877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da0095-9193-4386-9271-d0ff57c91c15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:26.419180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da0095-9193-4386-9271-d0ff57c91c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:26.421116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da0095-9193-4386-9271-d0ff57c91c15 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:26.430347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 413/822] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:26.436391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1c7cc-31f4-4569-969d-fe70b52ecbb0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:26.537179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1c7cc-31f4-4569-969d-fe70b52ecbb0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:26.571008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd87fab-dc42-4531-bee7-2f32d4d524ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:26.571795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87fab-dc42-4531-bee7-2f32d4d524ea None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:26.572065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87fab-dc42-4531-bee7-2f32d4d524ea None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:26.572332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87fab-dc42-4531-bee7-2f32d4d524ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:26.584376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd87fab-dc42-4531-bee7-2f32d4d524ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:26.585806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd87fab-dc42-4531-bee7-2f32d4d524ea None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8cd87fab-dc42-4531-bee7-2f32d4d524ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:26.602622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:26.604677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:26.607072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:26.607072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:26.607072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:26.607072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:26.607072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 410/823] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:26.610268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da0095-9193-4386-9271-d0ff57c91c15 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:26.709543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da0095-9193-4386-9271-d0ff57c91c15 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:26.742574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a21e39-0f4a-484c-99ec-81521a0cb552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:26.743224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a21e39-0f4a-484c-99ec-81521a0cb552 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:26.743505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a21e39-0f4a-484c-99ec-81521a0cb552 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:26.743777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a21e39-0f4a-484c-99ec-81521a0cb552 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:26.744479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a21e39-0f4a-484c-99ec-81521a0cb552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:26.744778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a21e39-0f4a-484c-99ec-81521a0cb552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:26.746168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a21e39-0f4a-484c-99ec-81521a0cb552 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:26.757800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 414/824] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:26.763045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd87fab-dc42-4531-bee7-2f32d4d524ea None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:26.861455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd87fab-dc42-4531-bee7-2f32d4d524ea None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:26.894195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb5ce5-9d0a-4044-bca9-c9c15adc4d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:26.894986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb5ce5-9d0a-4044-bca9-c9c15adc4d54 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:26.895262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb5ce5-9d0a-4044-bca9-c9c15adc4d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:26.895536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb5ce5-9d0a-4044-bca9-c9c15adc4d54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:26.903182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb5ce5-9d0a-4044-bca9-c9c15adc4d54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:26.905328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb5ce5-9d0a-4044-bca9-c9c15adc4d54 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-54eb5ce5-9d0a-4044-bca9-c9c15adc4d54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:26.919563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:26.922478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:26.924829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 411/825] 10.222.0.75 () {56 vars in 1093 bytes} [Tue May 17 15:29:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:26.930863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a21e39-0f4a-484c-99ec-81521a0cb552 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:27.031370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a21e39-0f4a-484c-99ec-81521a0cb552 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:27.065481 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45395259-388a-4867-8bd8-94fa1241752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:27.066170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45395259-388a-4867-8bd8-94fa1241752c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.066449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45395259-388a-4867-8bd8-94fa1241752c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.066717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45395259-388a-4867-8bd8-94fa1241752c None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.067541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45395259-388a-4867-8bd8-94fa1241752c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:27.067840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45395259-388a-4867-8bd8-94fa1241752c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:27.069253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45395259-388a-4867-8bd8-94fa1241752c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:27.086717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 415/826] 10.222.0.75 () {56 vars in 1133 bytes} [Tue May 17 15:29:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:27.092780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb5ce5-9d0a-4044-bca9-c9c15adc4d54 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:27.190345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb5ce5-9d0a-4044-bca9-c9c15adc4d54 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:27.223933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf972b9-60dd-4c59-a39a-18d921cb756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:27.224582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf972b9-60dd-4c59-a39a-18d921cb756e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.224859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf972b9-60dd-4c59-a39a-18d921cb756e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.225130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf972b9-60dd-4c59-a39a-18d921cb756e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.291654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf972b9-60dd-4c59-a39a-18d921cb756e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:27.293096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf972b9-60dd-4c59-a39a-18d921cb756e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:27.398501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 412/827] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:27 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:29:27.399815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45395259-388a-4867-8bd8-94fa1241752c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:27.502576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45395259-388a-4867-8bd8-94fa1241752c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:27.536930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6847-7f32-4897-b8dc-6aba109bb4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:27.537722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6847-7f32-4897-b8dc-6aba109bb4bd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.538015 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6847-7f32-4897-b8dc-6aba109bb4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.538288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6847-7f32-4897-b8dc-6aba109bb4bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.548824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6847-7f32-4897-b8dc-6aba109bb4bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:27.550420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6847-7f32-4897-b8dc-6aba109bb4bd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:27.552469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29695896-bda8-4161-a241-c3eb4cec7f83 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.552469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29695896-bda8-4161-a241-c3eb4cec7f83 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.552469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29695896-bda8-4161-a241-c3eb4cec7f83 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.557906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 413/828] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:27.560957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb9fa-a5cd-4188-addc-7525def1134e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.560957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb9fa-a5cd-4188-addc-7525def1134e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.560957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb9fa-a5cd-4188-addc-7525def1134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a9ee6847-7f32-4897-b8dc-6aba109bb4bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:27.569444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:27.570406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:27.571312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:27.571312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:27.571312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:27.571312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:27.574492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 416/829] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:27.577907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-30abb9fa-a5cd-4188-addc-7525def1134e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:27.579390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30abb9fa-a5cd-4188-addc-7525def1134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:27.582580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6847-7f32-4897-b8dc-6aba109bb4bd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:27.648321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 414/830] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:27.649824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088dcba-d4fd-47b2-b825-325deabcf94a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.650086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088dcba-d4fd-47b2-b825-325deabcf94a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.650361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088dcba-d4fd-47b2-b825-325deabcf94a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.651728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 415/831] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:27.659986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b73ba-bf03-4d86-aecb-2fa3a94ff874 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.660339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b73ba-bf03-4d86-aecb-2fa3a94ff874 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.660759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b73ba-bf03-4d86-aecb-2fa3a94ff874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.681821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c20b73ba-bf03-4d86-aecb-2fa3a94ff874 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:27.683110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c20b73ba-bf03-4d86-aecb-2fa3a94ff874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:27.703641 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6847-7f32-4897-b8dc-6aba109bb4bd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:27.737048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a85bf-6302-4511-b56d-6546a6f53695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:27.737736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a85bf-6302-4511-b56d-6546a6f53695 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.738039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a85bf-6302-4511-b56d-6546a6f53695 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.738307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a85bf-6302-4511-b56d-6546a6f53695 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.739044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a85bf-6302-4511-b56d-6546a6f53695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:27.739315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a85bf-6302-4511-b56d-6546a6f53695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:27.740671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a85bf-6302-4511-b56d-6546a6f53695 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:27.749436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 416/832] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:27.750315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b73ba-bf03-4d86-aecb-2fa3a94ff874 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:27.764964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 417/833] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:27.766679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a85bf-6302-4511-b56d-6546a6f53695 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:27.853848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b73ba-bf03-4d86-aecb-2fa3a94ff874 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:27.867770 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a85bf-6302-4511-b56d-6546a6f53695 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:27.887598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8f9e8-90c6-4ad5-89e5-a7d55e41c27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:27.888631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8f9e8-90c6-4ad5-89e5-a7d55e41c27c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.889577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8f9e8-90c6-4ad5-89e5-a7d55e41c27c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.889989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8f9e8-90c6-4ad5-89e5-a7d55e41c27c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.899680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8f9e8-90c6-4ad5-89e5-a7d55e41c27c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:27.900693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a4122-05c3-47f2-b2e7-4f77dba62f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:27.901423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4122-05c3-47f2-b2e7-4f77dba62f2a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:27.901702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4122-05c3-47f2-b2e7-4f77dba62f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:27.901975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4122-05c3-47f2-b2e7-4f77dba62f2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-0bf8f9e8-90c6-4ad5-89e5-a7d55e41c27c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:27.908692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:27.909755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:29:27.910768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:27.911474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4122-05c3-47f2-b2e7-4f77dba62f2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:27.911474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4122-05c3-47f2-b2e7-4f77dba62f2a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:27.913161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 417/834] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:29:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:27.914075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8f9e8-90c6-4ad5-89e5-a7d55e41c27c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-fa4a4122-05c3-47f2-b2e7-4f77dba62f2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:27.924437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:27.925492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:27.926594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:27.926594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:27.926594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:27.926594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:27.926594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:27.926594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:27.926594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:27.926594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:27.930541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 418/835] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:27.931299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a4122-05c3-47f2-b2e7-4f77dba62f2a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.014940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8f9e8-90c6-4ad5-89e5-a7d55e41c27c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.023745 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a4122-05c3-47f2-b2e7-4f77dba62f2a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.049682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be68bf-836e-410a-b560-c8667dd660e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.050598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be68bf-836e-410a-b560-c8667dd660e0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.050878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be68bf-836e-410a-b560-c8667dd660e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.051149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be68bf-836e-410a-b560-c8667dd660e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.061010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be68bf-836e-410a-b560-c8667dd660e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:28.062806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f160d-6bb9-490a-8da9-24edf09e6502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.063466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f160d-6bb9-490a-8da9-24edf09e6502 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.063744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f160d-6bb9-490a-8da9-24edf09e6502 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.064021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f160d-6bb9-490a-8da9-24edf09e6502 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.064744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f160d-6bb9-490a-8da9-24edf09e6502 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:28.065044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f160d-6bb9-490a-8da9-24edf09e6502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.066436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f160d-6bb9-490a-8da9-24edf09e6502 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-79be68bf-836e-410a-b560-c8667dd660e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:28.068485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:28.069426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:28.070291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:28.078822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 419/836] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:29:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:28.078997 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 418/837] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:28.079078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f160d-6bb9-490a-8da9-24edf09e6502 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.079170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bede7-79b4-4f91-a27b-cff09507a9b5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.079170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bede7-79b4-4f91-a27b-cff09507a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.079170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bede7-79b4-4f91-a27b-cff09507a9b5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.079170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 419/838] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:28.079170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bede7-79b4-4f91-a27b-cff09507a9b5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.170318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f160d-6bb9-490a-8da9-24edf09e6502 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.173880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bede7-79b4-4f91-a27b-cff09507a9b5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.201133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea4ed-3694-44fb-ab4f-76738a271434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.202357 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea4ed-3694-44fb-ab4f-76738a271434 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.202633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea4ed-3694-44fb-ab4f-76738a271434 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.202898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea4ed-3694-44fb-ab4f-76738a271434 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.203667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea4ed-3694-44fb-ab4f-76738a271434 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:28.203966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea4ed-3694-44fb-ab4f-76738a271434 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.205378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea4ed-3694-44fb-ab4f-76738a271434 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.205786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87081ce8-a6ea-4b89-9821-14e3393a0e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.206468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081ce8-a6ea-4b89-9821-14e3393a0e4e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.206748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081ce8-a6ea-4b89-9821-14e3393a0e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.207017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081ce8-a6ea-4b89-9821-14e3393a0e4e None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.207741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081ce8-a6ea-4b89-9821-14e3393a0e4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:28.208040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081ce8-a6ea-4b89-9821-14e3393a0e4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.209360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081ce8-a6ea-4b89-9821-14e3393a0e4e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.216702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 420/839] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:28.217598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 420/840] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:28.217709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea4ed-3694-44fb-ab4f-76738a271434 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.218616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d0bb-b3b7-4b83-968d-33609919803a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.218897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d0bb-b3b7-4b83-968d-33609919803a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.219167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d0bb-b3b7-4b83-968d-33609919803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.238208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-72e1d0bb-b3b7-4b83-968d-33609919803a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:28.239400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-72e1d0bb-b3b7-4b83-968d-33609919803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:28.301784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 421/841] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:28.302625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1d0bb-b3b7-4b83-968d-33609919803a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.325878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea4ed-3694-44fb-ab4f-76738a271434 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.358041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed320ddb-55d6-4142-bb2a-ecfd870dd595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.358823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed320ddb-55d6-4142-bb2a-ecfd870dd595 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.359100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed320ddb-55d6-4142-bb2a-ecfd870dd595 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.359367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed320ddb-55d6-4142-bb2a-ecfd870dd595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.368718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed320ddb-55d6-4142-bb2a-ecfd870dd595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.370205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed320ddb-55d6-4142-bb2a-ecfd870dd595 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ed320ddb-55d6-4142-bb2a-ecfd870dd595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:28.387161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:28.388122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:28.389589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:28.389589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:28.389589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:28.389589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:28.389589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 421/842] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:28.389589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed320ddb-55d6-4142-bb2a-ecfd870dd595 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.401076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1d0bb-b3b7-4b83-968d-33609919803a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.431980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b1bb-b800-479c-827a-0dc8de4a9392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.432578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b1bb-b800-479c-827a-0dc8de4a9392 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.432844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b1bb-b800-479c-827a-0dc8de4a9392 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.433116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b1bb-b800-479c-827a-0dc8de4a9392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.433936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912b1bb-b800-479c-827a-0dc8de4a9392 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8ef90c1c9c784d8792b3afe6e8e7fb31) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:28.434273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912b1bb-b800-479c-827a-0dc8de4a9392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.436218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912b1bb-b800-479c-827a-0dc8de4a9392 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.441759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 422/843] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/role_assignments?user.id=8ef90c1c9c784d8792b3afe6e8e7fb31&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=cb77715547a14bae950f68513af00d30 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:28.442543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b1bb-b800-479c-827a-0dc8de4a9392 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.485135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed320ddb-55d6-4142-bb2a-ecfd870dd595 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.522114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570beee-2a09-4fe8-82af-eb302d11556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.522921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570beee-2a09-4fe8-82af-eb302d11556c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.523203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570beee-2a09-4fe8-82af-eb302d11556c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.523476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570beee-2a09-4fe8-82af-eb302d11556c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.534212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570beee-2a09-4fe8-82af-eb302d11556c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.535673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570beee-2a09-4fe8-82af-eb302d11556c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.550187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b1bb-b800-479c-827a-0dc8de4a9392 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f570beee-2a09-4fe8-82af-eb302d11556c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:28.554095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:28.555010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:28.555928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:28.555928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:28.555928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:28.555928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:28.558324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 422/844] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:28.559859 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570beee-2a09-4fe8-82af-eb302d11556c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.585088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aaaa9-a010-4c89-9569-1224974b26ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.585889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aaaa9-a010-4c89-9569-1224974b26ae None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.586197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aaaa9-a010-4c89-9569-1224974b26ae None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.586468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aaaa9-a010-4c89-9569-1224974b26ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.587116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aaaa9-a010-4c89-9569-1224974b26ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.588492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aaaa9-a010-4c89-9569-1224974b26ae None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-5a2aaaa9-a010-4c89-9569-1224974b26ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:28.601054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:28.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:28.603189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 423/845] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:28.604443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aaaa9-a010-4c89-9569-1224974b26ae None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.668965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570beee-2a09-4fe8-82af-eb302d11556c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.706216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaecea1-e1fc-4d73-8dff-d1cb95746221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.707090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaecea1-e1fc-4d73-8dff-d1cb95746221 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.707633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaecea1-e1fc-4d73-8dff-d1cb95746221 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.707910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaecea1-e1fc-4d73-8dff-d1cb95746221 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.708624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaecea1-e1fc-4d73-8dff-d1cb95746221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:28.708925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaecea1-e1fc-4d73-8dff-d1cb95746221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.709273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aaaa9-a010-4c89-9569-1224974b26ae None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.710348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaecea1-e1fc-4d73-8dff-d1cb95746221 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.728527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 423/846] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:28.728527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaecea1-e1fc-4d73-8dff-d1cb95746221 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.742447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240600bc-0d62-4fcc-b1a5-a52c614f19f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.743104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240600bc-0d62-4fcc-b1a5-a52c614f19f2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.743383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240600bc-0d62-4fcc-b1a5-a52c614f19f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.743653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240600bc-0d62-4fcc-b1a5-a52c614f19f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.744364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240600bc-0d62-4fcc-b1a5-a52c614f19f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:28.744661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240600bc-0d62-4fcc-b1a5-a52c614f19f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.746026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240600bc-0d62-4fcc-b1a5-a52c614f19f2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.757850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 424/847] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:28.758676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240600bc-0d62-4fcc-b1a5-a52c614f19f2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.832666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaecea1-e1fc-4d73-8dff-d1cb95746221 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.853708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240600bc-0d62-4fcc-b1a5-a52c614f19f2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:28.867550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c815488-168a-4b3e-873d-a59438b3ff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.868366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c815488-168a-4b3e-873d-a59438b3ff17 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.868712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c815488-168a-4b3e-873d-a59438b3ff17 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.869054 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c815488-168a-4b3e-873d-a59438b3ff17 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.869819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c815488-168a-4b3e-873d-a59438b3ff17 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:28.870211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c815488-168a-4b3e-873d-a59438b3ff17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.871580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c815488-168a-4b3e-873d-a59438b3ff17 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.881225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 424/848] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:28.881225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c815488-168a-4b3e-873d-a59438b3ff17 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.895352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68564162-1726-4c07-91d2-a85440cd6777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:28.896432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68564162-1726-4c07-91d2-a85440cd6777 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:28.896711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68564162-1726-4c07-91d2-a85440cd6777 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:28.896980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68564162-1726-4c07-91d2-a85440cd6777 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:28.907023 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68564162-1726-4c07-91d2-a85440cd6777 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:28.908985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68564162-1726-4c07-91d2-a85440cd6777 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-68564162-1726-4c07-91d2-a85440cd6777 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:28.927214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:28.928170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:28.929110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:28.930405 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 425/849] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:28.931227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68564162-1726-4c07-91d2-a85440cd6777 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:28.977844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c815488-168a-4b3e-873d-a59438b3ff17 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.010504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eb47b-e492-4c2c-9068-0ff0e8054ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.011292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eb47b-e492-4c2c-9068-0ff0e8054ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.011560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eb47b-e492-4c2c-9068-0ff0e8054ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.011829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eb47b-e492-4c2c-9068-0ff0e8054ad1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.020297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eb47b-e492-4c2c-9068-0ff0e8054ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.021738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eb47b-e492-4c2c-9068-0ff0e8054ad1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.032060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68564162-1726-4c07-91d2-a85440cd6777 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-cf6eb47b-e492-4c2c-9068-0ff0e8054ad1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:29.035570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:29.036583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:29.037555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 425/850] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:29.038167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eb47b-e492-4c2c-9068-0ff0e8054ad1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:29.070654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6db8f2-5a1b-430b-9dfd-a15905a1f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.071306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6db8f2-5a1b-430b-9dfd-a15905a1f96a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.071584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6db8f2-5a1b-430b-9dfd-a15905a1f96a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.071850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6db8f2-5a1b-430b-9dfd-a15905a1f96a None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.072612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6db8f2-5a1b-430b-9dfd-a15905a1f96a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:29.072919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6db8f2-5a1b-430b-9dfd-a15905a1f96a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.074454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6db8f2-5a1b-430b-9dfd-a15905a1f96a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.090033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 426/851] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:29:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:29.090033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6db8f2-5a1b-430b-9dfd-a15905a1f96a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:29.137620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eb47b-e492-4c2c-9068-0ff0e8054ad1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.177172 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87da6-7569-4438-a559-9ee82932221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.177853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87da6-7569-4438-a559-9ee82932221e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.178168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87da6-7569-4438-a559-9ee82932221e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.178444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87da6-7569-4438-a559-9ee82932221e None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.179293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87da6-7569-4438-a559-9ee82932221e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:29.179600 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87da6-7569-4438-a559-9ee82932221e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.181067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87da6-7569-4438-a559-9ee82932221e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.199901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6db8f2-5a1b-430b-9dfd-a15905a1f96a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.200996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 426/852] 10.222.0.75 () {56 vars in 1149 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:29.206856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87da6-7569-4438-a559-9ee82932221e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:29.241107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419d823-cb11-436f-8367-3b5b327b551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.241712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419d823-cb11-436f-8367-3b5b327b551f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.241987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419d823-cb11-436f-8367-3b5b327b551f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.242300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419d823-cb11-436f-8367-3b5b327b551f None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.243149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419d823-cb11-436f-8367-3b5b327b551f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:29.243453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419d823-cb11-436f-8367-3b5b327b551f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.244902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419d823-cb11-436f-8367-3b5b327b551f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.269185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 427/853] 10.222.0.75 () {56 vars in 1135 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:29.271116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419d823-cb11-436f-8367-3b5b327b551f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:29.330727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87da6-7569-4438-a559-9ee82932221e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.368722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd79a69-6807-439f-9c22-c6cef1e69d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.369371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79a69-6807-439f-9c22-c6cef1e69d18 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.369648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79a69-6807-439f-9c22-c6cef1e69d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.369920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79a69-6807-439f-9c22-c6cef1e69d18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.384307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419d823-cb11-436f-8367-3b5b327b551f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.417358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738335c6-2e95-4cfe-b402-3333f931f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.418029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738335c6-2e95-4cfe-b402-3333f931f507 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.418311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738335c6-2e95-4cfe-b402-3333f931f507 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.418584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738335c6-2e95-4cfe-b402-3333f931f507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.437482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd79a69-6807-439f-9c22-c6cef1e69d18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.439028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd79a69-6807-439f-9c22-c6cef1e69d18 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.485505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738335c6-2e95-4cfe-b402-3333f931f507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.486985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738335c6-2e95-4cfe-b402-3333f931f507 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.540356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 427/854] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:29:29.541218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd79a69-6807-439f-9c22-c6cef1e69d18 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:29.584342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 428/855] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:29:29.589822 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738335c6-2e95-4cfe-b402-3333f931f507 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:29.666902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd79a69-6807-439f-9c22-c6cef1e69d18 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.700629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c747b-e6b8-428d-8b2c-83db88d25fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.701411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738335c6-2e95-4cfe-b402-3333f931f507 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.701526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c747b-e6b8-428d-8b2c-83db88d25fda None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.701706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c747b-e6b8-428d-8b2c-83db88d25fda None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.701983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c747b-e6b8-428d-8b2c-83db88d25fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.713357 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c747b-e6b8-428d-8b2c-83db88d25fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.714591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c747b-e6b8-428d-8b2c-83db88d25fda None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-326c747b-e6b8-428d-8b2c-83db88d25fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:29.733406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:29.734384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:29.735273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:29.735273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:29.735273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:29.735273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:29.739176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 428/856] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:29.740706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c747b-e6b8-428d-8b2c-83db88d25fda None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:29.744448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa8ce0-c328-47e8-b2aa-9ccbc43e7b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.746491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa8ce0-c328-47e8-b2aa-9ccbc43e7b3e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.746982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa8ce0-c328-47e8-b2aa-9ccbc43e7b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.747450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa8ce0-c328-47e8-b2aa-9ccbc43e7b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.761191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa8ce0-c328-47e8-b2aa-9ccbc43e7b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.763731 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa8ce0-c328-47e8-b2aa-9ccbc43e7b3e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1eaa8ce0-c328-47e8-b2aa-9ccbc43e7b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:29.783787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:29.784725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:29.785611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:29.785611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:29.785611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:29.785611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:29.789580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 429/857] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:29.790895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa8ce0-c328-47e8-b2aa-9ccbc43e7b3e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:29.858756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c747b-e6b8-428d-8b2c-83db88d25fda None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.892592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370eb0-ed58-4208-88dc-4823485e1d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.893638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370eb0-ed58-4208-88dc-4823485e1d61 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.893817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370eb0-ed58-4208-88dc-4823485e1d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.894073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370eb0-ed58-4208-88dc-4823485e1d61 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.894807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa370eb0-ed58-4208-88dc-4823485e1d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:29.895098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa370eb0-ed58-4208-88dc-4823485e1d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.896517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa370eb0-ed58-4208-88dc-4823485e1d61 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.903887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa8ce0-c328-47e8-b2aa-9ccbc43e7b3e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:29.912732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 429/858] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:29.913846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370eb0-ed58-4208-88dc-4823485e1d61 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:29.945523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506033b-8fcf-466b-857b-3688ca28d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:29.946582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506033b-8fcf-466b-857b-3688ca28d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:29.947077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506033b-8fcf-466b-857b-3688ca28d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:29.947661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506033b-8fcf-466b-857b-3688ca28d5a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:29.949352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506033b-8fcf-466b-857b-3688ca28d5a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:29.949837 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506033b-8fcf-466b-857b-3688ca28d5a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:29.951409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506033b-8fcf-466b-857b-3688ca28d5a4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:29.965419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 430/859] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:29.971836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506033b-8fcf-466b-857b-3688ca28d5a4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:30.026699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370eb0-ed58-4208-88dc-4823485e1d61 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:30.069736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a72300-d068-45df-9963-9b13234ff8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:30.071449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72300-d068-45df-9963-9b13234ff8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:30.071928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72300-d068-45df-9963-9b13234ff8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:30.072390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72300-d068-45df-9963-9b13234ff8d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:30.073048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506033b-8fcf-466b-857b-3688ca28d5a4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:30.081332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a72300-d068-45df-9963-9b13234ff8d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:30.083342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a72300-d068-45df-9963-9b13234ff8d1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-04a72300-d068-45df-9963-9b13234ff8d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:30.102871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:30.103779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:30.104741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:30.104741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:30.104741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:30.104741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:30.104741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:30.104741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:30.104741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:30.104741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:30.106928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 430/860] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:30.112713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a72300-d068-45df-9963-9b13234ff8d1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:30.114643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32bb25-fd4c-4362-b5b4-fa00bf502263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:30.115524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32bb25-fd4c-4362-b5b4-fa00bf502263 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:30.115883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32bb25-fd4c-4362-b5b4-fa00bf502263 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:30.116184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32bb25-fd4c-4362-b5b4-fa00bf502263 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:30.123430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32bb25-fd4c-4362-b5b4-fa00bf502263 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:30.124750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32bb25-fd4c-4362-b5b4-fa00bf502263 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3f32bb25-fd4c-4362-b5b4-fa00bf502263 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:30.140418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:30.141332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:30.142282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:30.142282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:30.142282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:30.142282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:30.142282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:30.142282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:30.142282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:30.142282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:30.150044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 431/861] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:30.151476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32bb25-fd4c-4362-b5b4-fa00bf502263 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:30.238978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a72300-d068-45df-9963-9b13234ff8d1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:30.262885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32bb25-fd4c-4362-b5b4-fa00bf502263 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:30.280080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376506b-154d-4a1d-8ff1-ec0145d26b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:30.281057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376506b-154d-4a1d-8ff1-ec0145d26b97 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:30.281513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376506b-154d-4a1d-8ff1-ec0145d26b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:30.282031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376506b-154d-4a1d-8ff1-ec0145d26b97 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:30.283010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376506b-154d-4a1d-8ff1-ec0145d26b97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:30.283510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376506b-154d-4a1d-8ff1-ec0145d26b97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:30.285127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376506b-154d-4a1d-8ff1-ec0145d26b97 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:30.297378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 431/862] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:30.298988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7741eb-112c-4b1b-a9ff-1c0b06aa3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:30.299900 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7741eb-112c-4b1b-a9ff-1c0b06aa3799 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:30.300384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7741eb-112c-4b1b-a9ff-1c0b06aa3799 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:30.300859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7741eb-112c-4b1b-a9ff-1c0b06aa3799 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:30.301854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7741eb-112c-4b1b-a9ff-1c0b06aa3799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:30.303163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376506b-154d-4a1d-8ff1-ec0145d26b97 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:30.303691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7741eb-112c-4b1b-a9ff-1c0b06aa3799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:30.305151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7741eb-112c-4b1b-a9ff-1c0b06aa3799 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:30.324312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 432/863] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:30.327201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7741eb-112c-4b1b-a9ff-1c0b06aa3799 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:30.428465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7741eb-112c-4b1b-a9ff-1c0b06aa3799 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:30.433764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376506b-154d-4a1d-8ff1-ec0145d26b97 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:30.465305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891ee6f-8814-434c-9ff2-63b5914fda26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:30.466613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891ee6f-8814-434c-9ff2-63b5914fda26 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:30.467128 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891ee6f-8814-434c-9ff2-63b5914fda26 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:30.467626 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891ee6f-8814-434c-9ff2-63b5914fda26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:30.468671 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891ee6f-8814-434c-9ff2-63b5914fda26 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=db2c811cad8a490891834991a6101984) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:30.469182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891ee6f-8814-434c-9ff2-63b5914fda26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:30.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bad46d-9348-4901-ba39-75544095827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:30.471349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891ee6f-8814-434c-9ff2-63b5914fda26 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:30.471682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bad46d-9348-4901-ba39-75544095827b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:30.471961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bad46d-9348-4901-ba39-75544095827b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:30.472234 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bad46d-9348-4901-ba39-75544095827b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:30.473054 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bad46d-9348-4901-ba39-75544095827b None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=ad2ea98f75654ec8882650e686135aab) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:30.473360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bad46d-9348-4901-ba39-75544095827b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:30.474852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bad46d-9348-4901-ba39-75544095827b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:30.486147 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 433/865] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:30 2022] GET /identity/v3/role_assignments?user.id=db2c811cad8a490891834991a6101984&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=cb77715547a14bae950f68513af00d30 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:30.486425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 432/865] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:30 2022] GET /identity/v3/role_assignments?user.id=ad2ea98f75654ec8882650e686135aab&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:30.767534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26afc-4396-4ea6-b9de-153deba5766b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:30.767876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26afc-4396-4ea6-b9de-153deba5766b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:30.768076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26afc-4396-4ea6-b9de-153deba5766b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:30.769614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 433/866] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:30.775922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c3964-fc03-4063-9e53-c273198fd23f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:30.776477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c3964-fc03-4063-9e53-c273198fd23f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:30.776952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c3964-fc03-4063-9e53-c273198fd23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:30.795800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bc6c3964-fc03-4063-9e53-c273198fd23f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:30.797313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bc6c3964-fc03-4063-9e53-c273198fd23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:30.868621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 434/867] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:30.891559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f26afc-4396-4ea6-b9de-153deba5766b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:30.996053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f26afc-4396-4ea6-b9de-153deba5766b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:31.030611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a0408-7a2a-4000-9172-04f2c55e842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:31.031346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a0408-7a2a-4000-9172-04f2c55e842f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:31.031623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a0408-7a2a-4000-9172-04f2c55e842f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:31.031894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a0408-7a2a-4000-9172-04f2c55e842f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:31.032541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a0408-7a2a-4000-9172-04f2c55e842f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:31.033915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a0408-7a2a-4000-9172-04f2c55e842f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-414a0408-7a2a-4000-9172-04f2c55e842f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:31.046267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:31.047266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:31.048525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 434/868] 10.222.0.75 () {56 vars in 1132 bytes} [Tue May 17 15:29:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:31.053887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c3964-fc03-4063-9e53-c273198fd23f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:31.161348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c3964-fc03-4063-9e53-c273198fd23f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:31.195818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aaba5-e0dc-4fab-b153-d2d0a6cde8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:31.196741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aaba5-e0dc-4fab-b153-d2d0a6cde8fa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:31.197172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aaba5-e0dc-4fab-b153-d2d0a6cde8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:31.197596 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aaba5-e0dc-4fab-b153-d2d0a6cde8fa None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:31.198464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aaba5-e0dc-4fab-b153-d2d0a6cde8fa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:31.198917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aaba5-e0dc-4fab-b153-d2d0a6cde8fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:31.200521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aaba5-e0dc-4fab-b153-d2d0a6cde8fa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:31.205333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 435/869] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:31.210601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a0408-7a2a-4000-9172-04f2c55e842f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:31.327059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a0408-7a2a-4000-9172-04f2c55e842f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:31.360844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff5672-cd21-4224-a7f2-3b5fe45ab075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:31.361504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5672-cd21-4224-a7f2-3b5fe45ab075 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:31.361780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5672-cd21-4224-a7f2-3b5fe45ab075 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:31.362079 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5672-cd21-4224-a7f2-3b5fe45ab075 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:31.362780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5672-cd21-4224-a7f2-3b5fe45ab075 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:31.363080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5672-cd21-4224-a7f2-3b5fe45ab075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:31.364447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5672-cd21-4224-a7f2-3b5fe45ab075 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:31.369283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 435/870] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:31.457139 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da820cd-cf9c-41ed-a489-7d24276e8950 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:31.457708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da820cd-cf9c-41ed-a489-7d24276e8950 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:31.457858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da820cd-cf9c-41ed-a489-7d24276e8950 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:31.459708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 436/871] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:31.465483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383da1-e392-46a3-9e27-f1624025de8c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:31.465831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383da1-e392-46a3-9e27-f1624025de8c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:31.466224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383da1-e392-46a3-9e27-f1624025de8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:31.486462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0d383da1-e392-46a3-9e27-f1624025de8c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:31.487877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0d383da1-e392-46a3-9e27-f1624025de8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:31.559011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 436/872] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:31.581368 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da820cd-cf9c-41ed-a489-7d24276e8950 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:31.680877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da820cd-cf9c-41ed-a489-7d24276e8950 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:31.717320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36011c-a227-4ee4-87ef-1f6df36bd481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:31.717986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36011c-a227-4ee4-87ef-1f6df36bd481 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:31.718289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36011c-a227-4ee4-87ef-1f6df36bd481 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:31.718561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36011c-a227-4ee4-87ef-1f6df36bd481 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:31.719285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36011c-a227-4ee4-87ef-1f6df36bd481 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:31.720629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36011c-a227-4ee4-87ef-1f6df36bd481 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:31.737003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 437/873] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:29:31 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:32.815642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145625c-1600-4e4b-a93d-eea3ba55abab None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:32.816190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145625c-1600-4e4b-a93d-eea3ba55abab None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:32.816190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145625c-1600-4e4b-a93d-eea3ba55abab None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:32.817774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 437/874] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:32.823264 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea2b83-8bdd-4286-bd2f-f398c3b37ce9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:32.823667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea2b83-8bdd-4286-bd2f-f398c3b37ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:32.823842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea2b83-8bdd-4286-bd2f-f398c3b37ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:32.840877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-86ea2b83-8bdd-4286-bd2f-f398c3b37ce9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:32.842121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-86ea2b83-8bdd-4286-bd2f-f398c3b37ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:32.922111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 438/875] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:32.941266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145625c-1600-4e4b-a93d-eea3ba55abab None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:32.962071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e6bb-43df-41e7-8cd8-c35e284e8cae None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:32.962393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e6bb-43df-41e7-8cd8-c35e284e8cae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:32.962763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e6bb-43df-41e7-8cd8-c35e284e8cae None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:32.964965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 439/876] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:32.971653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a915cee-73cc-495a-991f-aa5a18e0863a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:32.972067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a915cee-73cc-495a-991f-aa5a18e0863a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:32.972472 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a915cee-73cc-495a-991f-aa5a18e0863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:32.993371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1a915cee-73cc-495a-991f-aa5a18e0863a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:32.994967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1a915cee-73cc-495a-991f-aa5a18e0863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:33.058465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145625c-1600-4e4b-a93d-eea3ba55abab None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:33.086127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 440/877] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:33.098889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9877c70-f8d9-4b11-9362-b7d7b0824661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:33.099884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9877c70-f8d9-4b11-9362-b7d7b0824661 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.100353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9877c70-f8d9-4b11-9362-b7d7b0824661 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.100763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9877c70-f8d9-4b11-9362-b7d7b0824661 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.101597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9877c70-f8d9-4b11-9362-b7d7b0824661 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:33.103120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9877c70-f8d9-4b11-9362-b7d7b0824661 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:33.109562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a915cee-73cc-495a-991f-aa5a18e0863a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a9877c70-f8d9-4b11-9362-b7d7b0824661 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:33.116065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:33.117299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:33.118437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:33.120675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 438/878] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:33.130970 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9877c70-f8d9-4b11-9362-b7d7b0824661 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:33.225138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a915cee-73cc-495a-991f-aa5a18e0863a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:33.258110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9877c70-f8d9-4b11-9362-b7d7b0824661 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:33.262713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64305222-5465-4f1e-8fd6-f77ae97c8665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:33.263772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64305222-5465-4f1e-8fd6-f77ae97c8665 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.264213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64305222-5465-4f1e-8fd6-f77ae97c8665 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.264698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64305222-5465-4f1e-8fd6-f77ae97c8665 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.281771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64305222-5465-4f1e-8fd6-f77ae97c8665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-64305222-5465-4f1e-8fd6-f77ae97c8665 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:33.294576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:33.296438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:33.298263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 441/879] 10.222.0.75 () {56 vars in 1120 bytes} [Tue May 17 15:29:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:33.305339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb877b5-9c45-4859-bde3-7ad4ad795b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:33.305339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb877b5-9c45-4859-bde3-7ad4ad795b01 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.305645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb877b5-9c45-4859-bde3-7ad4ad795b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.305799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb877b5-9c45-4859-bde3-7ad4ad795b01 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.306418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb877b5-9c45-4859-bde3-7ad4ad795b01 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:33.306722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb877b5-9c45-4859-bde3-7ad4ad795b01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:33.307439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64305222-5465-4f1e-8fd6-f77ae97c8665 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:33.308105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb877b5-9c45-4859-bde3-7ad4ad795b01 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:33.318079 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 439/880] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:33.321491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb877b5-9c45-4859-bde3-7ad4ad795b01 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:33.412733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64305222-5465-4f1e-8fd6-f77ae97c8665 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:33.424323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb877b5-9c45-4859-bde3-7ad4ad795b01 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:33.447709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece15a6-109e-4e34-be4b-0f4a35230045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:33.448729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece15a6-109e-4e34-be4b-0f4a35230045 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.449214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece15a6-109e-4e34-be4b-0f4a35230045 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.449688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece15a6-109e-4e34-be4b-0f4a35230045 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.450700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece15a6-109e-4e34-be4b-0f4a35230045 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:33.451255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece15a6-109e-4e34-be4b-0f4a35230045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:33.452840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece15a6-109e-4e34-be4b-0f4a35230045 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:33.458116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403cb15-0535-4d81-9b59-7969edc40bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:33.458782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403cb15-0535-4d81-9b59-7969edc40bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.459392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403cb15-0535-4d81-9b59-7969edc40bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.459392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403cb15-0535-4d81-9b59-7969edc40bb0 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.460036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403cb15-0535-4d81-9b59-7969edc40bb0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:33.460341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403cb15-0535-4d81-9b59-7969edc40bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:33.461707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403cb15-0535-4d81-9b59-7969edc40bb0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:33.468748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 442/882] 10.222.0.75 () {56 vars in 1115 bytes} [Tue May 17 15:29:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:33.470199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece15a6-109e-4e34-be4b-0f4a35230045 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:33.472499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 440/882] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:33.586966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece15a6-109e-4e34-be4b-0f4a35230045 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:33.626271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845ea1-dd3e-492a-ba5b-4630b7e13707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:33.627488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845ea1-dd3e-492a-ba5b-4630b7e13707 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.627997 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845ea1-dd3e-492a-ba5b-4630b7e13707 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.628598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845ea1-dd3e-492a-ba5b-4630b7e13707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.641874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845ea1-dd3e-492a-ba5b-4630b7e13707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:33.643738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845ea1-dd3e-492a-ba5b-4630b7e13707 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ee845ea1-dd3e-492a-ba5b-4630b7e13707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:33.663514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:33.664457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:33.665765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:33.665765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:33.665765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:33.665765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:33.665765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 443/883] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:33.671458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403cb15-0535-4d81-9b59-7969edc40bb0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:33.674955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb0ba8-6ac1-411a-ac8f-c2304f9d8383 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.675304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb0ba8-6ac1-411a-ac8f-c2304f9d8383 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.675595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb0ba8-6ac1-411a-ac8f-c2304f9d8383 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.678066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 444/884] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:33.683127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae601445-b44c-42d3-948f-7e8342ce272f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.683414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae601445-b44c-42d3-948f-7e8342ce272f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.683690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae601445-b44c-42d3-948f-7e8342ce272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.700533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ae601445-b44c-42d3-948f-7e8342ce272f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:33.701737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ae601445-b44c-42d3-948f-7e8342ce272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:33.768714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 445/885] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:33.791194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae601445-b44c-42d3-948f-7e8342ce272f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:33.808049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403cb15-0535-4d81-9b59-7969edc40bb0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:33.849230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee11aef-ea2b-43d2-8045-1933ccb5e3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:33.850717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee11aef-ea2b-43d2-8045-1933ccb5e3fc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.851180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee11aef-ea2b-43d2-8045-1933ccb5e3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.851634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee11aef-ea2b-43d2-8045-1933ccb5e3fc None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.852571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee11aef-ea2b-43d2-8045-1933ccb5e3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:33.853168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee11aef-ea2b-43d2-8045-1933ccb5e3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:33.854792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee11aef-ea2b-43d2-8045-1933ccb5e3fc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:33.867175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 441/886] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:33.872688 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee11aef-ea2b-43d2-8045-1933ccb5e3fc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:33.889948 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae601445-b44c-42d3-948f-7e8342ce272f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:33.927468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418aca4f-e4b2-48f2-a5f3-88b781f55b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:33.928117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418aca4f-e4b2-48f2-a5f3-88b781f55b4d None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:33.928397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418aca4f-e4b2-48f2-a5f3-88b781f55b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:33.928669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418aca4f-e4b2-48f2-a5f3-88b781f55b4d None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:33.929470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418aca4f-e4b2-48f2-a5f3-88b781f55b4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:33.930933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418aca4f-e4b2-48f2-a5f3-88b781f55b4d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:33.950077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 446/887] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:29:33 2022] POST /identity/v3/services => generated 269 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:33.994664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee11aef-ea2b-43d2-8045-1933ccb5e3fc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:34.039734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570bb95-db9f-4058-b259-d1844376d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:34.040968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570bb95-db9f-4058-b259-d1844376d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.041497 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570bb95-db9f-4058-b259-d1844376d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.041976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570bb95-db9f-4058-b259-d1844376d5c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.050984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570bb95-db9f-4058-b259-d1844376d5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:34.052908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570bb95-db9f-4058-b259-d1844376d5c8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4570bb95-db9f-4058-b259-d1844376d5c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:34.069632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:34.070723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:34.071699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:34.074618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 442/888] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:29:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:34.081073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418aca4f-e4b2-48f2-a5f3-88b781f55b4d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:34.100665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844093f5-4327-49f4-8359-513dd7bbfaf4 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.101291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844093f5-4327-49f4-8359-513dd7bbfaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.101799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844093f5-4327-49f4-8359-513dd7bbfaf4 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.103769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 443/889] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:34.111151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe66b66-3673-4ed3-abc9-5bb71f9ac62c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.111474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe66b66-3673-4ed3-abc9-5bb71f9ac62c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.111693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe66b66-3673-4ed3-abc9-5bb71f9ac62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.137520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-afe66b66-3673-4ed3-abc9-5bb71f9ac62c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:34.140186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-afe66b66-3673-4ed3-abc9-5bb71f9ac62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:34.216233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418aca4f-e4b2-48f2-a5f3-88b781f55b4d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:34.229447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 444/890] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:34.251509 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe66b66-3673-4ed3-abc9-5bb71f9ac62c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:34.266430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15331403-8290-4cac-866e-5a624a149c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:34.268066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15331403-8290-4cac-866e-5a624a149c26 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.268545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15331403-8290-4cac-866e-5a624a149c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.269215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15331403-8290-4cac-866e-5a624a149c26 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.270623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15331403-8290-4cac-866e-5a624a149c26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:34.271151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15331403-8290-4cac-866e-5a624a149c26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:34.273281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15331403-8290-4cac-866e-5a624a149c26 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:34.296911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 447/891] 10.222.0.75 () {56 vars in 1149 bytes} [Tue May 17 15:29:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:34.302601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15331403-8290-4cac-866e-5a624a149c26 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:34.359754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe66b66-3673-4ed3-abc9-5bb71f9ac62c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:34.395443 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5bd3f-65ae-4fbd-b7ab-f49fb58830fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:34.396244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5bd3f-65ae-4fbd-b7ab-f49fb58830fe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.396604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5bd3f-65ae-4fbd-b7ab-f49fb58830fe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.396852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5bd3f-65ae-4fbd-b7ab-f49fb58830fe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.397561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5bd3f-65ae-4fbd-b7ab-f49fb58830fe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:34.399007 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5bd3f-65ae-4fbd-b7ab-f49fb58830fe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-abd5bd3f-65ae-4fbd-b7ab-f49fb58830fe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:34.411474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:34.412468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 15:29:34.413298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:34.417876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 445/892] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:29:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:34.418715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5bd3f-65ae-4fbd-b7ab-f49fb58830fe None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:34.423536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15331403-8290-4cac-866e-5a624a149c26 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:34.464528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edae3c7-1f29-4356-800c-0302ce2ee401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:34.465789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edae3c7-1f29-4356-800c-0302ce2ee401 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.466376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edae3c7-1f29-4356-800c-0302ce2ee401 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.467507 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edae3c7-1f29-4356-800c-0302ce2ee401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.524583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5bd3f-65ae-4fbd-b7ab-f49fb58830fe None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:34.543638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edae3c7-1f29-4356-800c-0302ce2ee401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:34.545695 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edae3c7-1f29-4356-800c-0302ce2ee401 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:34.568118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91958d1-bd0c-4efd-9e05-0fc3fee06c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:34.569260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91958d1-bd0c-4efd-9e05-0fc3fee06c0f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.569769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91958d1-bd0c-4efd-9e05-0fc3fee06c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.570381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91958d1-bd0c-4efd-9e05-0fc3fee06c0f None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.571111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91958d1-bd0c-4efd-9e05-0fc3fee06c0f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:34.571422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91958d1-bd0c-4efd-9e05-0fc3fee06c0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:34.573462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91958d1-bd0c-4efd-9e05-0fc3fee06c0f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:34.584260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 446/893] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:29:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:34.584519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91958d1-bd0c-4efd-9e05-0fc3fee06c0f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:34.667442 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 448/894] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:34 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:29:34.672887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edae3c7-1f29-4356-800c-0302ce2ee401 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:34.694268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91958d1-bd0c-4efd-9e05-0fc3fee06c0f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:34.729601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e03bf-3c2d-4c64-96ec-db38ccf87831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:34.730706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e03bf-3c2d-4c64-96ec-db38ccf87831 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.731193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e03bf-3c2d-4c64-96ec-db38ccf87831 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.731721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e03bf-3c2d-4c64-96ec-db38ccf87831 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.732670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e03bf-3c2d-4c64-96ec-db38ccf87831 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:34.733174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e03bf-3c2d-4c64-96ec-db38ccf87831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:34.734788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e03bf-3c2d-4c64-96ec-db38ccf87831 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:34.744839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 447/895] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:29:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:34.746482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e03bf-3c2d-4c64-96ec-db38ccf87831 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:34.775558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edae3c7-1f29-4356-800c-0302ce2ee401 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:34.809296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe891d7-1eac-4831-bd6a-a3b272c5671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:34.810123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe891d7-1eac-4831-bd6a-a3b272c5671d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.810426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe891d7-1eac-4831-bd6a-a3b272c5671d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.810700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe891d7-1eac-4831-bd6a-a3b272c5671d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.820778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe891d7-1eac-4831-bd6a-a3b272c5671d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:34.822355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe891d7-1eac-4831-bd6a-a3b272c5671d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6fe891d7-1eac-4831-bd6a-a3b272c5671d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:34.840313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:34.841279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:34.842799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:34.842799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:34.842799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:34.842799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:34.846925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 449/896] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:34.847776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe891d7-1eac-4831-bd6a-a3b272c5671d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:34.854467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e03bf-3c2d-4c64-96ec-db38ccf87831 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:34.890790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a091a8-9edf-4258-ac1c-f83a50791bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:34.891869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a091a8-9edf-4258-ac1c-f83a50791bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.892404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a091a8-9edf-4258-ac1c-f83a50791bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.892878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a091a8-9edf-4258-ac1c-f83a50791bb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.893919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a091a8-9edf-4258-ac1c-f83a50791bb4 None admin] RBAC: Adding query filter params (interface=public, service_id=e40d0661380a402ea2abd9309338773c, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:34.894470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a091a8-9edf-4258-ac1c-f83a50791bb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:34.896211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a091a8-9edf-4258-ac1c-f83a50791bb4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:34.906118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 448/897] 10.222.0.75 () {56 vars in 1251 bytes} [Tue May 17 15:29:34 2022] GET /identity/v3/endpoints?service_id=e40d0661380a402ea2abd9309338773c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:34.907550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a091a8-9edf-4258-ac1c-f83a50791bb4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:34.944841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe891d7-1eac-4831-bd6a-a3b272c5671d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:34.987521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6966cac-baa8-4fea-9546-46b820167d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:34.988298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6966cac-baa8-4fea-9546-46b820167d31 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:34.988410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6966cac-baa8-4fea-9546-46b820167d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:34.988659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6966cac-baa8-4fea-9546-46b820167d31 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:34.989383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6966cac-baa8-4fea-9546-46b820167d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:34.989691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6966cac-baa8-4fea-9546-46b820167d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:34.991209 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6966cac-baa8-4fea-9546-46b820167d31 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:35.007618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 450/898] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:35.008468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6966cac-baa8-4fea-9546-46b820167d31 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:35.014737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a091a8-9edf-4258-ac1c-f83a50791bb4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:35.050487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46fea-8b7b-4254-afe6-b4cadac50376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:35.051553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46fea-8b7b-4254-afe6-b4cadac50376 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:35.052040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46fea-8b7b-4254-afe6-b4cadac50376 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:35.052514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46fea-8b7b-4254-afe6-b4cadac50376 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:35.053396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b46fea-8b7b-4254-afe6-b4cadac50376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:35.055072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b46fea-8b7b-4254-afe6-b4cadac50376 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:35.070529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 449/899] 10.222.0.75 () {56 vars in 1087 bytes} [Tue May 17 15:29:34 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:29:35.113085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6966cac-baa8-4fea-9546-46b820167d31 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:35.150940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877896-d507-4648-a0b7-28585c387e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:35.151758 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877896-d507-4648-a0b7-28585c387e54 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:35.152043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877896-d507-4648-a0b7-28585c387e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:35.152316 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877896-d507-4648-a0b7-28585c387e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:35.160521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c877896-d507-4648-a0b7-28585c387e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:35.162021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c877896-d507-4648-a0b7-28585c387e54 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3c877896-d507-4648-a0b7-28585c387e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:35.177755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:35.178805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:35.179708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:35.179708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:35.179708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:35.179708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:35.179708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:35.179708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:35.179708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:35.179708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:35.179708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 451/900] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:35.185049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46fea-8b7b-4254-afe6-b4cadac50376 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:35.301904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46fea-8b7b-4254-afe6-b4cadac50376 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:35.348396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e5eba-0875-4320-869d-05fbdcde3ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:35.349065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5eba-0875-4320-869d-05fbdcde3ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:35.351533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5eba-0875-4320-869d-05fbdcde3ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:35.351825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5eba-0875-4320-869d-05fbdcde3ed4 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:35.352680 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e5eba-0875-4320-869d-05fbdcde3ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:35.352995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e5eba-0875-4320-869d-05fbdcde3ed4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:35.354523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e5eba-0875-4320-869d-05fbdcde3ed4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:35.369846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 450/901] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:35.376350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877896-d507-4648-a0b7-28585c387e54 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:35.475610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877896-d507-4648-a0b7-28585c387e54 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:35.509657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445c7ff-5ed1-484b-929a-a88c156e00ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:35.510331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445c7ff-5ed1-484b-929a-a88c156e00ff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:35.510609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445c7ff-5ed1-484b-929a-a88c156e00ff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:35.510875 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445c7ff-5ed1-484b-929a-a88c156e00ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:35.511695 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445c7ff-5ed1-484b-929a-a88c156e00ff None admin] RBAC: Adding query filter params (role.id=90070bf28cac41abaa6ce1d3935dfad3, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=ad2ea98f75654ec8882650e686135aab) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:35.511996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445c7ff-5ed1-484b-929a-a88c156e00ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:35.513443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445c7ff-5ed1-484b-929a-a88c156e00ff None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:35.519356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 452/902] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:35 2022] GET /identity/v3/role_assignments?user.id=ad2ea98f75654ec8882650e686135aab&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=90070bf28cac41abaa6ce1d3935dfad3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:35.815681 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c563a32-f7c7-4c7f-ae0b-9f028bae1e4d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:35.816061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c563a32-f7c7-4c7f-ae0b-9f028bae1e4d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:35.816407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c563a32-f7c7-4c7f-ae0b-9f028bae1e4d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:35.818062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 451/903] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:35.823489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad664b-f17b-4b19-b5c4-b6d67ca7a83f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:35.823884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad664b-f17b-4b19-b5c4-b6d67ca7a83f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:35.824256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad664b-f17b-4b19-b5c4-b6d67ca7a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:35.842258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-44ad664b-f17b-4b19-b5c4-b6d67ca7a83f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:35.843563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44ad664b-f17b-4b19-b5c4-b6d67ca7a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:35.910717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 453/904] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:35.933645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c563a32-f7c7-4c7f-ae0b-9f028bae1e4d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:36.033646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c563a32-f7c7-4c7f-ae0b-9f028bae1e4d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:36.068515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964880e8-4747-4335-be10-dc78823cf373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:36.069120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964880e8-4747-4335-be10-dc78823cf373 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:36.069402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964880e8-4747-4335-be10-dc78823cf373 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:36.069686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964880e8-4747-4335-be10-dc78823cf373 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:36.070468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964880e8-4747-4335-be10-dc78823cf373 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:36.071897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964880e8-4747-4335-be10-dc78823cf373 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:36.090230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 452/905] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:29:35 2022] POST /identity/v3/services => generated 241 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:36.267872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0458345-31ff-47cd-8708-4fddf5077ffe None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:36.268415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0458345-31ff-47cd-8708-4fddf5077ffe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:36.268415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0458345-31ff-47cd-8708-4fddf5077ffe None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:36.270086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 454/906] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:36.275982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116c8ac-e7aa-4964-9c2e-aa12258d3a56 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:36.275982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116c8ac-e7aa-4964-9c2e-aa12258d3a56 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:36.276247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116c8ac-e7aa-4964-9c2e-aa12258d3a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:36.293750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6116c8ac-e7aa-4964-9c2e-aa12258d3a56 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:36.295001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6116c8ac-e7aa-4964-9c2e-aa12258d3a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:36.369424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 453/907] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:36.393741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0458345-31ff-47cd-8708-4fddf5077ffe None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:36.496994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0458345-31ff-47cd-8708-4fddf5077ffe None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:36.530774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c4b44-a618-401e-a224-47413701a78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:36.531580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4b44-a618-401e-a224-47413701a78f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:36.531855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4b44-a618-401e-a224-47413701a78f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:36.532121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4b44-a618-401e-a224-47413701a78f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:36.532765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c4b44-a618-401e-a224-47413701a78f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:36.534146 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c4b44-a618-401e-a224-47413701a78f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-cf1c4b44-a618-401e-a224-47413701a78f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:36.546204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:36.547173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:36.548047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 455/908] 10.222.0.75 () {56 vars in 1132 bytes} [Tue May 17 15:29:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:36.555405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116c8ac-e7aa-4964-9c2e-aa12258d3a56 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:36.653026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116c8ac-e7aa-4964-9c2e-aa12258d3a56 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:36.689735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c187dd6-5384-49ee-96a4-5c903ea4b139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:36.690808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c187dd6-5384-49ee-96a4-5c903ea4b139 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:36.691285 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c187dd6-5384-49ee-96a4-5c903ea4b139 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:36.691772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c187dd6-5384-49ee-96a4-5c903ea4b139 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:36.692685 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c187dd6-5384-49ee-96a4-5c903ea4b139 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:36.693249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c187dd6-5384-49ee-96a4-5c903ea4b139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:36.694905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c187dd6-5384-49ee-96a4-5c903ea4b139 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:36.704012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 454/909] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:36.709782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c4b44-a618-401e-a224-47413701a78f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:36.815241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c4b44-a618-401e-a224-47413701a78f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:36.849300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9221-5cd3-4cb6-b51a-91944134e394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:36.849969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9221-5cd3-4cb6-b51a-91944134e394 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:36.850319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9221-5cd3-4cb6-b51a-91944134e394 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:36.850569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9221-5cd3-4cb6-b51a-91944134e394 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:36.851255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9221-5cd3-4cb6-b51a-91944134e394 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:36.854022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9221-5cd3-4cb6-b51a-91944134e394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:36.854022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9221-5cd3-4cb6-b51a-91944134e394 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:36.859216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 456/910] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:36.869221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c187dd6-5384-49ee-96a4-5c903ea4b139 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:36.980199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c187dd6-5384-49ee-96a4-5c903ea4b139 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:37.014909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703c50-f3e8-4c65-b45e-2f3a645f0068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:37.015568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703c50-f3e8-4c65-b45e-2f3a645f0068 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:37.015847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703c50-f3e8-4c65-b45e-2f3a645f0068 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:37.016121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703c50-f3e8-4c65-b45e-2f3a645f0068 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:37.016911 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8703c50-f3e8-4c65-b45e-2f3a645f0068 None admin] RBAC: Adding query filter params (interface=public, service_id=facbebaf2f3c468493e7632794503d21, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:37.017218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8703c50-f3e8-4c65-b45e-2f3a645f0068 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:37.018622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8703c50-f3e8-4c65-b45e-2f3a645f0068 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:37.024228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 455/911] 10.222.0.75 () {56 vars in 1251 bytes} [Tue May 17 15:29:36 2022] GET /identity/v3/endpoints?service_id=facbebaf2f3c468493e7632794503d21&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:37.029605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9221-5cd3-4cb6-b51a-91944134e394 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:37.148299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9221-5cd3-4cb6-b51a-91944134e394 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:37.181315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f6171-f996-4025-8483-653a7e996960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:37.181976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f6171-f996-4025-8483-653a7e996960 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:37.182277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f6171-f996-4025-8483-653a7e996960 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:37.182546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f6171-f996-4025-8483-653a7e996960 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:37.183268 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f6171-f996-4025-8483-653a7e996960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:37.184618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f6171-f996-4025-8483-653a7e996960 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:37.191547 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 457/912] 10.222.0.75 () {56 vars in 1087 bytes} [Tue May 17 15:29:37 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:29:37.531727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d83273-1a15-418a-9297-df75d8a1e317 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:37.532128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d83273-1a15-418a-9297-df75d8a1e317 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:37.532330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d83273-1a15-418a-9297-df75d8a1e317 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:37.533914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 456/913] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:37.539086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964cdc-6912-40b0-b9bf-be1ed59650c1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:37.539522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964cdc-6912-40b0-b9bf-be1ed59650c1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:37.539688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964cdc-6912-40b0-b9bf-be1ed59650c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:37.557273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-93964cdc-6912-40b0-b9bf-be1ed59650c1 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:37.558514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-93964cdc-6912-40b0-b9bf-be1ed59650c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:37.627385 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 458/914] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:37.651263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d83273-1a15-418a-9297-df75d8a1e317 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:37.762553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d83273-1a15-418a-9297-df75d8a1e317 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:37.798062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de9363-9fa7-4e79-b08a-20acffeb9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:37.798784 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de9363-9fa7-4e79-b08a-20acffeb9fbe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:37.799067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de9363-9fa7-4e79-b08a-20acffeb9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:37.799340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de9363-9fa7-4e79-b08a-20acffeb9fbe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:37.799984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de9363-9fa7-4e79-b08a-20acffeb9fbe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:37.801346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de9363-9fa7-4e79-b08a-20acffeb9fbe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-38de9363-9fa7-4e79-b08a-20acffeb9fbe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:37.813368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:37.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:37.815288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 457/915] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:29:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:37.820672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964cdc-6912-40b0-b9bf-be1ed59650c1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:37.850742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749030-1bd4-4351-a5da-29869bd10489 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:37.851114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749030-1bd4-4351-a5da-29869bd10489 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:37.851464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749030-1bd4-4351-a5da-29869bd10489 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:37.853161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 458/916] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:37.858450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba96a-bf68-4e13-b1a9-be9535e38745 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:37.858805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba96a-bf68-4e13-b1a9-be9535e38745 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:37.859148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba96a-bf68-4e13-b1a9-be9535e38745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:37.875628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-84fba96a-bf68-4e13-b1a9-be9535e38745 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:37.876902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-84fba96a-bf68-4e13-b1a9-be9535e38745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:37.928279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964cdc-6912-40b0-b9bf-be1ed59650c1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:37.954112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 459/917] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:37.965665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0f29-fb73-4833-a026-98e18e893085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:37.966487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0f29-fb73-4833-a026-98e18e893085 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:37.966768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0f29-fb73-4833-a026-98e18e893085 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:37.967037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0f29-fb73-4833-a026-98e18e893085 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:37.967751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b0f29-fb73-4833-a026-98e18e893085 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:37.968050 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b0f29-fb73-4833-a026-98e18e893085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:37.968647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fba96a-bf68-4e13-b1a9-be9535e38745 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:37.969496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b0f29-fb73-4833-a026-98e18e893085 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:37.975688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 459/918] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:29:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:37.980780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0f29-fb73-4833-a026-98e18e893085 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:38.068397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fba96a-bf68-4e13-b1a9-be9535e38745 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:38.093047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0f29-fb73-4833-a026-98e18e893085 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:38.103222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9064f3-0372-4ec0-88ce-780de1dccf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:38.104037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9064f3-0372-4ec0-88ce-780de1dccf02 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.104315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9064f3-0372-4ec0-88ce-780de1dccf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.104588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9064f3-0372-4ec0-88ce-780de1dccf02 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.115002 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9064f3-0372-4ec0-88ce-780de1dccf02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4f9064f3-0372-4ec0-88ce-780de1dccf02 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:38.123690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:38.125815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:38.127832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:38.129760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 460/919] 10.222.0.75 () {56 vars in 1120 bytes} [Tue May 17 15:29:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:38.131329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9064f3-0372-4ec0-88ce-780de1dccf02 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:38.135197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7a199-90ea-438e-b0d8-4eefb0a0035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:38.136719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7a199-90ea-438e-b0d8-4eefb0a0035f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.137004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7a199-90ea-438e-b0d8-4eefb0a0035f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.137273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7a199-90ea-438e-b0d8-4eefb0a0035f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.138073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7a199-90ea-438e-b0d8-4eefb0a0035f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:38.138447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7a199-90ea-438e-b0d8-4eefb0a0035f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:38.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7a199-90ea-438e-b0d8-4eefb0a0035f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:38.146853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 460/920] 10.222.0.75 () {56 vars in 1114 bytes} [Tue May 17 15:29:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:38.151782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7a199-90ea-438e-b0d8-4eefb0a0035f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:38.255405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9064f3-0372-4ec0-88ce-780de1dccf02 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:38.285245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7a199-90ea-438e-b0d8-4eefb0a0035f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:38.300041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9777418-b477-4bdf-a795-1e230365a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:38.301090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9777418-b477-4bdf-a795-1e230365a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.301377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9777418-b477-4bdf-a795-1e230365a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.301654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9777418-b477-4bdf-a795-1e230365a9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.303063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9777418-b477-4bdf-a795-1e230365a9f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:38.303607 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9777418-b477-4bdf-a795-1e230365a9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:38.305744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9777418-b477-4bdf-a795-1e230365a9f6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:38.317017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 461/921] 10.222.0.75 () {56 vars in 1115 bytes} [Tue May 17 15:29:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:38.323554 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9777418-b477-4bdf-a795-1e230365a9f6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:38.327722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7e3f5-6779-4a21-99ec-4e965befe444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:38.328400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7e3f5-6779-4a21-99ec-4e965befe444 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.328678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7e3f5-6779-4a21-99ec-4e965befe444 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.328951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7e3f5-6779-4a21-99ec-4e965befe444 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.329725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7e3f5-6779-4a21-99ec-4e965befe444 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:38.331260 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7e3f5-6779-4a21-99ec-4e965befe444 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:38.365976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 461/922] 10.222.0.75 () {60 vars in 1144 bytes} [Tue May 17 15:29:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:38.455120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9777418-b477-4bdf-a795-1e230365a9f6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:38.501484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e8b28-bba4-4b06-8e8c-753cbc8b97de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:38.502328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8b28-bba4-4b06-8e8c-753cbc8b97de None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.502607 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8b28-bba4-4b06-8e8c-753cbc8b97de None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.502879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8b28-bba4-4b06-8e8c-753cbc8b97de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.516862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e8b28-bba4-4b06-8e8c-753cbc8b97de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:38.518390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e8b28-bba4-4b06-8e8c-753cbc8b97de None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-990e8b28-bba4-4b06-8e8c-753cbc8b97de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:38.538239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:38.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:38.540544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:38.540544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:38.540544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:38.540544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:38.540850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba392688-3fe3-4930-acc2-36317ad1d815 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.540850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba392688-3fe3-4930-acc2-36317ad1d815 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.540850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba392688-3fe3-4930-acc2-36317ad1d815 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.541575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 462/923] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:38.541657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 462/924] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:38.547174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e2a57-6ff8-4988-b1f5-3e58654a8957 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.547457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e2a57-6ff8-4988-b1f5-3e58654a8957 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.547729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e2a57-6ff8-4988-b1f5-3e58654a8957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.550220 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba392688-3fe3-4930-acc2-36317ad1d815 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:38.568246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-725e2a57-6ff8-4988-b1f5-3e58654a8957 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:38.569752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-725e2a57-6ff8-4988-b1f5-3e58654a8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:38.656447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 463/925] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:38.667040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba392688-3fe3-4930-acc2-36317ad1d815 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:38.678284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e2a57-6ff8-4988-b1f5-3e58654a8957 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:38.702250 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d915c12-2e66-4b3a-9bf8-caadeb0a2a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:38.702926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d915c12-2e66-4b3a-9bf8-caadeb0a2a44 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.703186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d915c12-2e66-4b3a-9bf8-caadeb0a2a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.703452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d915c12-2e66-4b3a-9bf8-caadeb0a2a44 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.704179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d915c12-2e66-4b3a-9bf8-caadeb0a2a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:38.704484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d915c12-2e66-4b3a-9bf8-caadeb0a2a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:38.705848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d915c12-2e66-4b3a-9bf8-caadeb0a2a44 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:38.718046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 463/926] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:38.723557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d915c12-2e66-4b3a-9bf8-caadeb0a2a44 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:38.796533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e2a57-6ff8-4988-b1f5-3e58654a8957 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:38.837316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b70ee6-b540-4271-b5fa-554bc30a9740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:38.839005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b70ee6-b540-4271-b5fa-554bc30a9740 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.839477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b70ee6-b540-4271-b5fa-554bc30a9740 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.839934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b70ee6-b540-4271-b5fa-554bc30a9740 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.840687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d915c12-2e66-4b3a-9bf8-caadeb0a2a44 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:38.841001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b70ee6-b540-4271-b5fa-554bc30a9740 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:38.843315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b70ee6-b540-4271-b5fa-554bc30a9740 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f0b70ee6-b540-4271-b5fa-554bc30a9740 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:38.860006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:38.861057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:38.861938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:38.865102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 464/927] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:38.870563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b70ee6-b540-4271-b5fa-554bc30a9740 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:38.886298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294abea-8799-41c2-8779-8159e6578c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:38.887946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294abea-8799-41c2-8779-8159e6578c16 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:38.888470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294abea-8799-41c2-8779-8159e6578c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:38.889158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294abea-8799-41c2-8779-8159e6578c16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:38.899244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294abea-8799-41c2-8779-8159e6578c16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:38.901672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294abea-8799-41c2-8779-8159e6578c16 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d294abea-8799-41c2-8779-8159e6578c16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:38.921501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:38.922515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:38.923466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:38.930464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 464/928] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:29:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:38.932642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294abea-8799-41c2-8779-8159e6578c16 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:38.991087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b70ee6-b540-4271-b5fa-554bc30a9740 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.035692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb8a48-3c9c-46a6-bf43-67ce9a591306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.036380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8a48-3c9c-46a6-bf43-67ce9a591306 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.036656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8a48-3c9c-46a6-bf43-67ce9a591306 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.036926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8a48-3c9c-46a6-bf43-67ce9a591306 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.037632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb8a48-3c9c-46a6-bf43-67ce9a591306 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:39.038359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb8a48-3c9c-46a6-bf43-67ce9a591306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.040018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb8a48-3c9c-46a6-bf43-67ce9a591306 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.050152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 465/929] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:39.053159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb8a48-3c9c-46a6-bf43-67ce9a591306 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.055962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294abea-8799-41c2-8779-8159e6578c16 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.090801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc473-fb2c-4f15-b1e5-b857f460b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.091710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc473-fb2c-4f15-b1e5-b857f460b010 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.092030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc473-fb2c-4f15-b1e5-b857f460b010 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.092401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc473-fb2c-4f15-b1e5-b857f460b010 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.093340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc473-fb2c-4f15-b1e5-b857f460b010 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:39.093754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc473-fb2c-4f15-b1e5-b857f460b010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.095303 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc473-fb2c-4f15-b1e5-b857f460b010 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.120536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 465/930] 10.222.0.75 () {56 vars in 1149 bytes} [Tue May 17 15:29:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:39.124606 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc473-fb2c-4f15-b1e5-b857f460b010 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.168281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb8a48-3c9c-46a6-bf43-67ce9a591306 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.203470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383cd15-14f1-4408-972b-ad5a4cecdc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.204363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383cd15-14f1-4408-972b-ad5a4cecdc29 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.204789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383cd15-14f1-4408-972b-ad5a4cecdc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.205240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383cd15-14f1-4408-972b-ad5a4cecdc29 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.206141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383cd15-14f1-4408-972b-ad5a4cecdc29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:39.206673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383cd15-14f1-4408-972b-ad5a4cecdc29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.208251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383cd15-14f1-4408-972b-ad5a4cecdc29 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.218069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 466/931] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:39.219774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383cd15-14f1-4408-972b-ad5a4cecdc29 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.229453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc473-fb2c-4f15-b1e5-b857f460b010 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.264285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4867f-659a-4619-9978-7bb80a3f7346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.265072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4867f-659a-4619-9978-7bb80a3f7346 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.265366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4867f-659a-4619-9978-7bb80a3f7346 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.266043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4867f-659a-4619-9978-7bb80a3f7346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.281813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4867f-659a-4619-9978-7bb80a3f7346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.283207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4867f-659a-4619-9978-7bb80a3f7346 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4ac4867f-659a-4619-9978-7bb80a3f7346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:39.301881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:39.302841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:39.303725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:39.303725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:39.303725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:39.303725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:39.307711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 466/932] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:39.308981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4867f-659a-4619-9978-7bb80a3f7346 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.331870 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383cd15-14f1-4408-972b-ad5a4cecdc29 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.368537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716933c2-2de5-4b03-a573-4ce4a11df4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.369571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716933c2-2de5-4b03-a573-4ce4a11df4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.370128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716933c2-2de5-4b03-a573-4ce4a11df4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.370622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716933c2-2de5-4b03-a573-4ce4a11df4b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.371646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716933c2-2de5-4b03-a573-4ce4a11df4b3 None admin] RBAC: Adding query filter params (interface=public, service_id=7d2c08d45f014f1bae200a8fb17301b1, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:39.372145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716933c2-2de5-4b03-a573-4ce4a11df4b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.374283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716933c2-2de5-4b03-a573-4ce4a11df4b3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.384226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 467/933] 10.222.0.75 () {56 vars in 1251 bytes} [Tue May 17 15:29:39 2022] GET /identity/v3/endpoints?service_id=7d2c08d45f014f1bae200a8fb17301b1&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:39.385351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716933c2-2de5-4b03-a573-4ce4a11df4b3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.412496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4867f-659a-4619-9978-7bb80a3f7346 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.446578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c4baf-9639-4092-8fed-af8c9f015fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.447242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c4baf-9639-4092-8fed-af8c9f015fbb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.447524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c4baf-9639-4092-8fed-af8c9f015fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.447801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c4baf-9639-4092-8fed-af8c9f015fbb None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.448517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c4baf-9639-4092-8fed-af8c9f015fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:39.448820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c4baf-9639-4092-8fed-af8c9f015fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.450229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c4baf-9639-4092-8fed-af8c9f015fbb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.470368 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 467/934] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:39.473088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c4baf-9639-4092-8fed-af8c9f015fbb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.489014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716933c2-2de5-4b03-a573-4ce4a11df4b3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.523364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90a870-2c7f-4295-b82f-c14625c39c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.524035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a870-2c7f-4295-b82f-c14625c39c2d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.524298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a870-2c7f-4295-b82f-c14625c39c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.524564 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a870-2c7f-4295-b82f-c14625c39c2d None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.525232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90a870-2c7f-4295-b82f-c14625c39c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.526620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90a870-2c7f-4295-b82f-c14625c39c2d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.532825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 468/935] 10.222.0.75 () {56 vars in 1087 bytes} [Tue May 17 15:29:39 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:29:39.540299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58bfb1-2cfb-447b-8f36-850b52e6bc5a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.540960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58bfb1-2cfb-447b-8f36-850b52e6bc5a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.541434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58bfb1-2cfb-447b-8f36-850b52e6bc5a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.543735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 469/936] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:39.550433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea2bd-e153-47f0-9b3c-7b073708465f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.550945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea2bd-e153-47f0-9b3c-7b073708465f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.551391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea2bd-e153-47f0-9b3c-7b073708465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.569807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-710ea2bd-e153-47f0-9b3c-7b073708465f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:39.571312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-710ea2bd-e153-47f0-9b3c-7b073708465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:39.595506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c4baf-9639-4092-8fed-af8c9f015fbb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.647017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92047c58-e917-4320-a46e-fba966901fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.648202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 470/937] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:39.650262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92047c58-e917-4320-a46e-fba966901fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.650713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92047c58-e917-4320-a46e-fba966901fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.651173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92047c58-e917-4320-a46e-fba966901fa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.661717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92047c58-e917-4320-a46e-fba966901fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.663560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92047c58-e917-4320-a46e-fba966901fa1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.674383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ea2bd-e153-47f0-9b3c-7b073708465f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-92047c58-e917-4320-a46e-fba966901fa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:39.682185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:39.683169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:39.689776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:39.689776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:39.689776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:39.689776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:39.689776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:39.689776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:39.689776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:39.689776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:39.689776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 468/938] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:39.691906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92047c58-e917-4320-a46e-fba966901fa1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.792241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ea2bd-e153-47f0-9b3c-7b073708465f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.820020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92047c58-e917-4320-a46e-fba966901fa1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.827664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb8f04-9159-47f1-ab1d-ef179f48f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.828726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb8f04-9159-47f1-ab1d-ef179f48f497 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.829205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb8f04-9159-47f1-ab1d-ef179f48f497 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.829674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb8f04-9159-47f1-ab1d-ef179f48f497 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.830585 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb8f04-9159-47f1-ab1d-ef179f48f497 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.832274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb8f04-9159-47f1-ab1d-ef179f48f497 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f6fb8f04-9159-47f1-ab1d-ef179f48f497 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:39.844557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:39.845526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 15:29:39.846973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:39.849687 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 471/939] 10.222.0.75 () {56 vars in 1132 bytes} [Tue May 17 15:29:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:39.855180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb8f04-9159-47f1-ab1d-ef179f48f497 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.858824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbb026-38d5-449a-af85-fc21de1a6fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:39.859546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbb026-38d5-449a-af85-fc21de1a6fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:39.859824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbb026-38d5-449a-af85-fc21de1a6fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:39.860109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbb026-38d5-449a-af85-fc21de1a6fc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:39.860904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbb026-38d5-449a-af85-fc21de1a6fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:39.861208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbb026-38d5-449a-af85-fc21de1a6fc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:39.862654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbb026-38d5-449a-af85-fc21de1a6fc9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:39.879971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 469/940] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:39.881237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbb026-38d5-449a-af85-fc21de1a6fc9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:39.962447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb8f04-9159-47f1-ab1d-ef179f48f497 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:39.995016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbb026-38d5-449a-af85-fc21de1a6fc9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:40.006279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043d270-7721-4677-ad44-1021b231898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:40.007248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043d270-7721-4677-ad44-1021b231898c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:40.007749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043d270-7721-4677-ad44-1021b231898c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:40.008255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043d270-7721-4677-ad44-1021b231898c None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:40.009154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043d270-7721-4677-ad44-1021b231898c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:40.009655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043d270-7721-4677-ad44-1021b231898c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:40.011303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043d270-7721-4677-ad44-1021b231898c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:40.021480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 472/941] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:40.022638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043d270-7721-4677-ad44-1021b231898c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:40.034970 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a86e7-732a-4f61-afe0-d398beb13331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:40.036176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a86e7-732a-4f61-afe0-d398beb13331 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:40.036459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a86e7-732a-4f61-afe0-d398beb13331 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:40.036735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a86e7-732a-4f61-afe0-d398beb13331 None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/ad2ea98f75654ec8882650e686135aab/roles/90070bf28cac41abaa6ce1d3935dfad3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:40.039461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a86e7-732a-4f61-afe0-d398beb13331 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=ad2ea98f75654ec8882650e686135aab, role_id=90070bf28cac41abaa6ce1d3935dfad3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:40.041543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a86e7-732a-4f61-afe0-d398beb13331 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:40.066266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 470/942] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:29:39 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/ad2ea98f75654ec8882650e686135aab/roles/90070bf28cac41abaa6ce1d3935dfad3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:29:40.132891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043d270-7721-4677-ad44-1021b231898c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:40.175202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff1615-3745-4338-b44a-79100561276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:40.175955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1615-3745-4338-b44a-79100561276c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:40.176168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1615-3745-4338-b44a-79100561276c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:40.176448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1615-3745-4338-b44a-79100561276c None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:40.177163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff1615-3745-4338-b44a-79100561276c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:40.177477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff1615-3745-4338-b44a-79100561276c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:40.178898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff1615-3745-4338-b44a-79100561276c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:40.184557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 473/943] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:40.191201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a86e7-732a-4f61-afe0-d398beb13331 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:40.306330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a86e7-732a-4f61-afe0-d398beb13331 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:40.339367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae290b9f-d839-4ab9-90de-6665fd72d5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:40.339945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae290b9f-d839-4ab9-90de-6665fd72d5c7 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:40.340230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae290b9f-d839-4ab9-90de-6665fd72d5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:40.340504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae290b9f-d839-4ab9-90de-6665fd72d5c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:40.341235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae290b9f-d839-4ab9-90de-6665fd72d5c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:40.343133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae290b9f-d839-4ab9-90de-6665fd72d5c7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:40.367593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 471/944] 10.222.0.75 () {60 vars in 1144 bytes} [Tue May 17 15:29:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:40.743446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df71d2f-1843-4c59-ab9b-3696bbf4a88c None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:40.743828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df71d2f-1843-4c59-ab9b-3696bbf4a88c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:40.744004 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df71d2f-1843-4c59-ab9b-3696bbf4a88c None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:40.745584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 474/945] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:40.751057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabde3-d7f1-4b37-bcfe-ac6ad92d44da None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:40.751492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabde3-d7f1-4b37-bcfe-ac6ad92d44da None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:40.751671 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabde3-d7f1-4b37-bcfe-ac6ad92d44da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:40.768627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-faeabde3-d7f1-4b37-bcfe-ac6ad92d44da None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:40.769791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-faeabde3-d7f1-4b37-bcfe-ac6ad92d44da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:40.839917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 472/946] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:40.863542 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df71d2f-1843-4c59-ab9b-3696bbf4a88c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:40.965757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df71d2f-1843-4c59-ab9b-3696bbf4a88c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:40.999916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:41.000502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:41.000877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:41.001155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:41.001837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:41.003288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:41.004652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WARNING keystone.server.flask.common [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 15:29:41.023363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.sql.core [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 15:29:41.023363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 15:29:41.023363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [parameters: {'id': '733c2e6d62af4d2db11c9617fa716907', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 15:29:41.023363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 733c2e6d62af4d2db11c9617fa716907.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 733c2e6d62af4d2db11c9617fa716907. May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 15:29:41.031960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 17 15:29:41.032854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return project_ref.to_dict() May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application yield resource May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.rollback() May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.force_reraise() May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise self.value May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application session.commit() May 17 15:29:41.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._prepare_impl() May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.flush() May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._flush(objects) May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application compat.raise_( May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application flush_context.execute() May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 15:29:41.034728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rec.execute(self) May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 15:29:41.035616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 15:29:41.036450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [parameters: {'id': '733c2e6d62af4d2db11c9617fa716907', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:41.037333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:41.039386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.Conflict( May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 733c2e6d62af4d2db11c9617fa716907. May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:41.041188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 475/947] 10.222.0.75 () {60 vars in 1140 bytes} [Tue May 17 15:29:40 2022] POST /identity/v3/projects => generated 262 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:41.041892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeabde3-d7f1-4b37-bcfe-ac6ad92d44da None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:41.139223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeabde3-d7f1-4b37-bcfe-ac6ad92d44da None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:41.173482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a93d7e-cdbd-421b-9e6c-328679423e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:41.174309 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a93d7e-cdbd-421b-9e6c-328679423e0e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:41.174589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a93d7e-cdbd-421b-9e6c-328679423e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:41.174860 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a93d7e-cdbd-421b-9e6c-328679423e0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:41.181712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a93d7e-cdbd-421b-9e6c-328679423e0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:41.183180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a93d7e-cdbd-421b-9e6c-328679423e0e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-94a93d7e-cdbd-421b-9e6c-328679423e0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:41.196899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:41.197809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:41.198736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:41.198736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:41.198736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:41.198736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:41.198736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:41.198736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:41.198736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:41.198736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:41.198736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 473/948] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:41.205183 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:41.309561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f350-5e1f-46dc-ba27-995c22d6b575 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:41.343479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04972d0e-5954-47ab-b988-bc9c31e21cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:41.344141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04972d0e-5954-47ab-b988-bc9c31e21cfa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:41.344421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04972d0e-5954-47ab-b988-bc9c31e21cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:41.344694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04972d0e-5954-47ab-b988-bc9c31e21cfa None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:41.345447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04972d0e-5954-47ab-b988-bc9c31e21cfa None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:41.345994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04972d0e-5954-47ab-b988-bc9c31e21cfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:41.347667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04972d0e-5954-47ab-b988-bc9c31e21cfa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:41.368291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 476/949] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:41.823297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fede1-ccd4-421d-bb49-6efe9b433b74 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:41.824153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fede1-ccd4-421d-bb49-6efe9b433b74 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:41.824571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fede1-ccd4-421d-bb49-6efe9b433b74 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:41.826976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 474/950] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:41.832808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1dd4-329f-4490-b9ff-d052e8fcc24b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:41.833370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1dd4-329f-4490-b9ff-d052e8fcc24b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:41.834064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1dd4-329f-4490-b9ff-d052e8fcc24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:41.852281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-791f1dd4-329f-4490-b9ff-d052e8fcc24b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:41.854918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-791f1dd4-329f-4490-b9ff-d052e8fcc24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:41.921683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 477/951] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:41.945369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fede1-ccd4-421d-bb49-6efe9b433b74 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:42.051185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fede1-ccd4-421d-bb49-6efe9b433b74 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:42.085052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07648b2c-0858-4a17-9c75-171e6395f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:42.086208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648b2c-0858-4a17-9c75-171e6395f5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.086707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648b2c-0858-4a17-9c75-171e6395f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.087247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648b2c-0858-4a17-9c75-171e6395f5a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.088102 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07648b2c-0858-4a17-9c75-171e6395f5a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:42.089683 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07648b2c-0858-4a17-9c75-171e6395f5a6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-07648b2c-0858-4a17-9c75-171e6395f5a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:42.102477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:42.103506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:42.104342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:42.107714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 475/952] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:42.113921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f1dd4-329f-4490-b9ff-d052e8fcc24b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:42.222159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f1dd4-329f-4490-b9ff-d052e8fcc24b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:42.266343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7713f67-ce03-44ba-b740-894059a67810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:42.267405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7713f67-ce03-44ba-b740-894059a67810 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.267891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7713f67-ce03-44ba-b740-894059a67810 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.268374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7713f67-ce03-44ba-b740-894059a67810 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.269296 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7713f67-ce03-44ba-b740-894059a67810 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:42.269814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7713f67-ce03-44ba-b740-894059a67810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:42.271409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7713f67-ce03-44ba-b740-894059a67810 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:42.276923 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 478/953] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:42.282197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07648b2c-0858-4a17-9c75-171e6395f5a6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:42.384407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07648b2c-0858-4a17-9c75-171e6395f5a6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:42.408352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e7de-4b7e-4845-bdb7-016ff8a9b084 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.408641 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e7de-4b7e-4845-bdb7-016ff8a9b084 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.408910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e7de-4b7e-4845-bdb7-016ff8a9b084 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.411594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 479/954] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:42.415679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9a15-77f0-4f22-8b56-119d7fbd7f36 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.415968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9a15-77f0-4f22-8b56-119d7fbd7f36 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.416250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9a15-77f0-4f22-8b56-119d7fbd7f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.417226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98196cac-88e9-48f1-9593-eaaf4db23ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:42.417885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98196cac-88e9-48f1-9593-eaaf4db23ffd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.418293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98196cac-88e9-48f1-9593-eaaf4db23ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.418568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98196cac-88e9-48f1-9593-eaaf4db23ffd None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.419885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98196cac-88e9-48f1-9593-eaaf4db23ffd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:42.420188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98196cac-88e9-48f1-9593-eaaf4db23ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:42.421628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98196cac-88e9-48f1-9593-eaaf4db23ffd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:42.426764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 476/955] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:42.432096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98196cac-88e9-48f1-9593-eaaf4db23ffd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:42.433785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-aeaf9a15-77f0-4f22-8b56-119d7fbd7f36 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:42.435663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aeaf9a15-77f0-4f22-8b56-119d7fbd7f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:42.510111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 480/956] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:42.524896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9a15-77f0-4f22-8b56-119d7fbd7f36 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:42.530662 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98196cac-88e9-48f1-9593-eaaf4db23ffd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:42.563757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5622-0c5c-4d1c-b65b-ef7216de1a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:42.564412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5622-0c5c-4d1c-b65b-ef7216de1a1f None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.564688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5622-0c5c-4d1c-b65b-ef7216de1a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.564959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5622-0c5c-4d1c-b65b-ef7216de1a1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.565694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab5622-0c5c-4d1c-b65b-ef7216de1a1f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:42.567192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab5622-0c5c-4d1c-b65b-ef7216de1a1f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:42.589796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 477/957] 10.222.0.75 () {60 vars in 1144 bytes} [Tue May 17 15:29:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:29:42.637110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9a15-77f0-4f22-8b56-119d7fbd7f36 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:42.681422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc81f77-3735-469c-b194-e439969e1317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:42.682278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc81f77-3735-469c-b194-e439969e1317 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.682559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc81f77-3735-469c-b194-e439969e1317 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.682831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc81f77-3735-469c-b194-e439969e1317 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.695239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc81f77-3735-469c-b194-e439969e1317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-acc81f77-3735-469c-b194-e439969e1317 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:42.704030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:42.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:42.706217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 481/958] 10.222.0.75 () {56 vars in 1120 bytes} [Tue May 17 15:29:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:42.713392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5622-0c5c-4d1c-b65b-ef7216de1a1f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:42.787464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca35612-88ff-47fa-9171-73224dad53ec None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.787817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca35612-88ff-47fa-9171-73224dad53ec None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.788023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca35612-88ff-47fa-9171-73224dad53ec None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.789646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 482/959] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:42.796148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95882945-bbf0-4924-a68b-008357bffb32 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.796148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95882945-bbf0-4924-a68b-008357bffb32 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.796148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95882945-bbf0-4924-a68b-008357bffb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.813905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-95882945-bbf0-4924-a68b-008357bffb32 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:42.815108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-95882945-bbf0-4924-a68b-008357bffb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:42.829519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5622-0c5c-4d1c-b65b-ef7216de1a1f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:42.867869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3590b3d-033a-4769-9002-53c0e76c2016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:42.868542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3590b3d-033a-4769-9002-53c0e76c2016 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:42.868822 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3590b3d-033a-4769-9002-53c0e76c2016 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:42.869094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3590b3d-033a-4769-9002-53c0e76c2016 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:42.869843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3590b3d-033a-4769-9002-53c0e76c2016 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:42.870197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3590b3d-033a-4769-9002-53c0e76c2016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:42.871563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3590b3d-033a-4769-9002-53c0e76c2016 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:42.883040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 478/960] 10.222.0.75 () {56 vars in 1115 bytes} [Tue May 17 15:29:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:42.888422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3590b3d-033a-4769-9002-53c0e76c2016 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:42.902125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 483/961] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:42.923937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95882945-bbf0-4924-a68b-008357bffb32 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:43.003860 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3590b3d-033a-4769-9002-53c0e76c2016 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:43.037115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827645a1-7912-4266-a6a6-ad0543f4a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:43.038289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827645a1-7912-4266-a6a6-ad0543f4a411 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.038778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827645a1-7912-4266-a6a6-ad0543f4a411 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.039277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827645a1-7912-4266-a6a6-ad0543f4a411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.045252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95882945-bbf0-4924-a68b-008357bffb32 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:43.050952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827645a1-7912-4266-a6a6-ad0543f4a411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:43.052647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827645a1-7912-4266-a6a6-ad0543f4a411 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-827645a1-7912-4266-a6a6-ad0543f4a411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:43.070944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:43.071884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:43.072770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:43.072770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:43.072770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:43.072770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:43.079458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 479/962] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:43.080925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827645a1-7912-4266-a6a6-ad0543f4a411 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:43.084219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87af8-32d1-43f2-898e-e9dd24d68701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:43.085330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87af8-32d1-43f2-898e-e9dd24d68701 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.085832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87af8-32d1-43f2-898e-e9dd24d68701 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.086396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87af8-32d1-43f2-898e-e9dd24d68701 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.087316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87af8-32d1-43f2-898e-e9dd24d68701 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:43.088888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87af8-32d1-43f2-898e-e9dd24d68701 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4df87af8-32d1-43f2-898e-e9dd24d68701 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:43.101484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:43.102698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 15:29:43.103547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:43.111062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 484/963] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:43.112928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87af8-32d1-43f2-898e-e9dd24d68701 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:43.195608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827645a1-7912-4266-a6a6-ad0543f4a411 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:43.230341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b022e-b939-4aab-8cb5-b7174811a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:43.234300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b022e-b939-4aab-8cb5-b7174811a464 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.234300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b022e-b939-4aab-8cb5-b7174811a464 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.234300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b022e-b939-4aab-8cb5-b7174811a464 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.234300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b022e-b939-4aab-8cb5-b7174811a464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:43.234300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b022e-b939-4aab-8cb5-b7174811a464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:43.234834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b022e-b939-4aab-8cb5-b7174811a464 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:43.249320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 480/964] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:43.254464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b022e-b939-4aab-8cb5-b7174811a464 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:43.255572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87af8-32d1-43f2-898e-e9dd24d68701 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:43.298635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb6908-d8c0-45e3-81a2-5f123f59f0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:43.299936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6908-d8c0-45e3-81a2-5f123f59f0ca None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.300422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6908-d8c0-45e3-81a2-5f123f59f0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.301081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6908-d8c0-45e3-81a2-5f123f59f0ca None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.302402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb6908-d8c0-45e3-81a2-5f123f59f0ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:43.303139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb6908-d8c0-45e3-81a2-5f123f59f0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:43.305150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb6908-d8c0-45e3-81a2-5f123f59f0ca None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:43.312238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 485/965] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:43.318540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb6908-d8c0-45e3-81a2-5f123f59f0ca None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:43.368572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b022e-b939-4aab-8cb5-b7174811a464 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:43.412645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466793-3baa-418e-b201-7fd752a8c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:43.414191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466793-3baa-418e-b201-7fd752a8c86e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.414908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466793-3baa-418e-b201-7fd752a8c86e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.415384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466793-3baa-418e-b201-7fd752a8c86e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.425914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb6908-d8c0-45e3-81a2-5f123f59f0ca None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:43.426234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e466793-3baa-418e-b201-7fd752a8c86e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:43.428137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e466793-3baa-418e-b201-7fd752a8c86e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8e466793-3baa-418e-b201-7fd752a8c86e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:43.447653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:43.448637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 15:29:43.449576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:43.456281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 481/966] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:29:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:43.456903 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466793-3baa-418e-b201-7fd752a8c86e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:43.469010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0d2bd-9e37-4ad5-88c4-97c0ca5c1a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:43.469775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0d2bd-9e37-4ad5-88c4-97c0ca5c1a69 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.470100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0d2bd-9e37-4ad5-88c4-97c0ca5c1a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.470444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0d2bd-9e37-4ad5-88c4-97c0ca5c1a69 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.471424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0d2bd-9e37-4ad5-88c4-97c0ca5c1a69 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:43.471782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0d2bd-9e37-4ad5-88c4-97c0ca5c1a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:43.473161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0d2bd-9e37-4ad5-88c4-97c0ca5c1a69 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:43.486201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 486/967] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:43.572219 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466793-3baa-418e-b201-7fd752a8c86e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:43.613711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ed2fc-7a0a-4684-82cc-c59ef9300a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:43.614847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed2fc-7a0a-4684-82cc-c59ef9300a71 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.615429 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed2fc-7a0a-4684-82cc-c59ef9300a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.615932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed2fc-7a0a-4684-82cc-c59ef9300a71 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.617026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed2fc-7a0a-4684-82cc-c59ef9300a71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:43.617565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed2fc-7a0a-4684-82cc-c59ef9300a71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:43.619328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed2fc-7a0a-4684-82cc-c59ef9300a71 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:43.639922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 482/968] 10.222.0.75 () {56 vars in 1149 bytes} [Tue May 17 15:29:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:43.647159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0d2bd-9e37-4ad5-88c4-97c0ca5c1a69 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:43.747611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0d2bd-9e37-4ad5-88c4-97c0ca5c1a69 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:43.767246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fb1b-8633-4f72-9b5c-2032b4dad283 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.767848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fb1b-8633-4f72-9b5c-2032b4dad283 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.768209 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fb1b-8633-4f72-9b5c-2032b4dad283 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.769926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 483/969] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:43.775544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33aa3-8c94-4d85-aec4-194187a9b3fe None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.776065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33aa3-8c94-4d85-aec4-194187a9b3fe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.776533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33aa3-8c94-4d85-aec4-194187a9b3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.786929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797bca0-115e-489c-8efa-31dc80908c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:43.787584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797bca0-115e-489c-8efa-31dc80908c4c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:43.787865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797bca0-115e-489c-8efa-31dc80908c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:43.788155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797bca0-115e-489c-8efa-31dc80908c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:43.794831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-03f33aa3-8c94-4d85-aec4-194187a9b3fe None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:43.796348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-03f33aa3-8c94-4d85-aec4-194187a9b3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:43.869440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797bca0-115e-489c-8efa-31dc80908c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:43.871025 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797bca0-115e-489c-8efa-31dc80908c4c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:43.873036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 484/970] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:43.897678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f33aa3-8c94-4d85-aec4-194187a9b3fe None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:43.983050 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 487/971] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:43 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:29:43.987429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797bca0-115e-489c-8efa-31dc80908c4c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:44.018878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f33aa3-8c94-4d85-aec4-194187a9b3fe None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:44.052370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:44.053064 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.053334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.053606 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.054342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:44.055760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:44.057059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.common [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 15:29:44.072505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.sql.core [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 15:29:44.072505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 15:29:44.072505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [parameters: {'user_id': 'c23708ec2c494270a5c0ebc7dd24f233', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 15:29:44.072505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80423) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 15:29:44.092892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797bca0-115e-489c-8efa-31dc80908c4c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application result = self._query(query) May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application conn.query(q) May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application result.read() May 17 15:29:44.093545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 15:29:44.094605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application next(self.gen) May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application yield resource May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application next(self.gen) May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.session.rollback() May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.force_reraise() May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise self.value May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application session.commit() May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 15:29:44.095689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._prepare_impl() May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.session.flush() May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._flush(objects) May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application compat.raise_( May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application flush_context.execute() May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rec.execute(self) May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 15:29:44.096885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application result = connection._execute_20( May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 15:29:44.097786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application result = self._query(query) May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application conn.query(q) May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application result.read() May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 15:29:44.098689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c23708ec2c494270a5c0ebc7dd24f233', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:44.099543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 17 15:29:44.100473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 17 15:29:44.101411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 17 15:29:44.101411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 17 15:29:44.101411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 15:29:44.101411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 15:29:44.101411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 15:29:44.101411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:44.104708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 485/972] 10.222.0.75 () {60 vars in 1131 bytes} [Tue May 17 15:29:43 2022] POST /identity/v3/users => generated 160 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:44.110692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:44.133925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ffe36-3e11-419b-b64c-f59846365271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:44.134813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ffe36-3e11-419b-b64c-f59846365271 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.135089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ffe36-3e11-419b-b64c-f59846365271 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.135356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ffe36-3e11-419b-b64c-f59846365271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.145899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ffe36-3e11-419b-b64c-f59846365271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:44.147621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ffe36-3e11-419b-b64c-f59846365271 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4b4ffe36-3e11-419b-b64c-f59846365271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:44.172180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:44.173116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:44.174619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:44.174619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:44.174619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:44.174619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:44.178311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 488/973] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:44.179401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ffe36-3e11-419b-b64c-f59846365271 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:44.218653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649afff-c412-43fe-95e1-6a3f0408f168 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:44.255425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872f59-5dcc-45c0-b12b-fcd3f7fc3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:44.256616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872f59-5dcc-45c0-b12b-fcd3f7fc3a96 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.257118 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872f59-5dcc-45c0-b12b-fcd3f7fc3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.257593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872f59-5dcc-45c0-b12b-fcd3f7fc3a96 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.266879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c872f59-5dcc-45c0-b12b-fcd3f7fc3a96 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:44.268843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c872f59-5dcc-45c0-b12b-fcd3f7fc3a96 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2c872f59-5dcc-45c0-b12b-fcd3f7fc3a96 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:44.283436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:44.284404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 15:29:44.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:44.288021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 486/974] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:44.293774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872f59-5dcc-45c0-b12b-fcd3f7fc3a96 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:44.300305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ffe36-3e11-419b-b64c-f59846365271 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:44.334827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df540e6d-8e7e-407f-a584-9aebb6b4270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:44.335543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df540e6d-8e7e-407f-a584-9aebb6b4270f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.335825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df540e6d-8e7e-407f-a584-9aebb6b4270f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.336097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df540e6d-8e7e-407f-a584-9aebb6b4270f None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.336816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df540e6d-8e7e-407f-a584-9aebb6b4270f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:44.337122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df540e6d-8e7e-407f-a584-9aebb6b4270f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:44.338545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df540e6d-8e7e-407f-a584-9aebb6b4270f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:44.354027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 489/975] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:44.355721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df540e6d-8e7e-407f-a584-9aebb6b4270f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:44.412578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872f59-5dcc-45c0-b12b-fcd3f7fc3a96 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:44.451412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48c20e-3431-4fb3-ba8a-ad9c2297629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:44.452783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48c20e-3431-4fb3-ba8a-ad9c2297629b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.453641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48c20e-3431-4fb3-ba8a-ad9c2297629b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.454190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48c20e-3431-4fb3-ba8a-ad9c2297629b None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.455437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48c20e-3431-4fb3-ba8a-ad9c2297629b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:44.456339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48c20e-3431-4fb3-ba8a-ad9c2297629b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:44.458480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48c20e-3431-4fb3-ba8a-ad9c2297629b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:44.474172 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df540e6d-8e7e-407f-a584-9aebb6b4270f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:44.507082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb7123-ecd1-488e-b0fb-92371c14223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:44.507979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb7123-ecd1-488e-b0fb-92371c14223c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.508324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb7123-ecd1-488e-b0fb-92371c14223c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.508666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb7123-ecd1-488e-b0fb-92371c14223c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.516392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb7123-ecd1-488e-b0fb-92371c14223c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:44.516799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 487/976] 10.222.0.75 () {56 vars in 1101 bytes} [Tue May 17 15:29:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:44.518121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb7123-ecd1-488e-b0fb-92371c14223c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4acb7123-ecd1-488e-b0fb-92371c14223c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:44.535217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:44.536166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:44.537076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:44.537076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:44.537076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:44.537076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:44.537076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:44.537076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:44.537076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:44.537076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:44.537076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 490/977] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:44.543786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48c20e-3431-4fb3-ba8a-ad9c2297629b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:44.657202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48c20e-3431-4fb3-ba8a-ad9c2297629b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:44.703040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf392cc2-0696-4991-8b00-a722dbd09e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:44.704407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf392cc2-0696-4991-8b00-a722dbd09e99 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.705065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf392cc2-0696-4991-8b00-a722dbd09e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.705736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf392cc2-0696-4991-8b00-a722dbd09e99 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.707232 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf392cc2-0696-4991-8b00-a722dbd09e99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:44.707951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf392cc2-0696-4991-8b00-a722dbd09e99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:44.710475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf392cc2-0696-4991-8b00-a722dbd09e99 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:44.728562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 488/978] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:44.736777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb7123-ecd1-488e-b0fb-92371c14223c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:44.846513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb7123-ecd1-488e-b0fb-92371c14223c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:44.880196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb17b0-1305-4aba-8e7c-f8e7fa834010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:44.881168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb17b0-1305-4aba-8e7c-f8e7fa834010 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.881658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb17b0-1305-4aba-8e7c-f8e7fa834010 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.882217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb17b0-1305-4aba-8e7c-f8e7fa834010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.883241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb17b0-1305-4aba-8e7c-f8e7fa834010 None admin] RBAC: Adding query filter params (role.id=90070bf28cac41abaa6ce1d3935dfad3, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=ad2ea98f75654ec8882650e686135aab) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:44.883765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb17b0-1305-4aba-8e7c-f8e7fa834010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:44.885383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb17b0-1305-4aba-8e7c-f8e7fa834010 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:44.891626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 491/979] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:44 2022] GET /identity/v3/role_assignments?user.id=ad2ea98f75654ec8882650e686135aab&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=90070bf28cac41abaa6ce1d3935dfad3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:44.962891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba264-6e2b-4197-8013-b8206d5c37bc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.963440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba264-6e2b-4197-8013-b8206d5c37bc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.963440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba264-6e2b-4197-8013-b8206d5c37bc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.965020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 489/980] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:44.971397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078303-1fb6-4996-b33d-69dbdb5e4c50 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:44.971747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078303-1fb6-4996-b33d-69dbdb5e4c50 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:44.971958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078303-1fb6-4996-b33d-69dbdb5e4c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:44.989678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-74078303-1fb6-4996-b33d-69dbdb5e4c50 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:44.990917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-74078303-1fb6-4996-b33d-69dbdb5e4c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:45.066435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 492/981] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:45.089438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba264-6e2b-4197-8013-b8206d5c37bc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:45.194804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba264-6e2b-4197-8013-b8206d5c37bc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:45.227555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39740b-8fe8-4c36-a566-8760b9278aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:45.228356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39740b-8fe8-4c36-a566-8760b9278aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:45.228638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39740b-8fe8-4c36-a566-8760b9278aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:45.228911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39740b-8fe8-4c36-a566-8760b9278aa0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:45.229562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39740b-8fe8-4c36-a566-8760b9278aa0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:45.233476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39740b-8fe8-4c36-a566-8760b9278aa0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4f39740b-8fe8-4c36-a566-8760b9278aa0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:45.246589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:45.247686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:45.253502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 490/982] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:45.255939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078303-1fb6-4996-b33d-69dbdb5e4c50 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:45.350458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078303-1fb6-4996-b33d-69dbdb5e4c50 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:45.381853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5eca8-360f-45ef-8daa-a85304488141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:45.382556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5eca8-360f-45ef-8daa-a85304488141 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:45.382838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5eca8-360f-45ef-8daa-a85304488141 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:45.383109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5eca8-360f-45ef-8daa-a85304488141 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:45.383803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5eca8-360f-45ef-8daa-a85304488141 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:45.384119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5eca8-360f-45ef-8daa-a85304488141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:45.385457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5eca8-360f-45ef-8daa-a85304488141 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:45.395513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 493/983] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:45.396757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39740b-8fe8-4c36-a566-8760b9278aa0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:45.498723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39740b-8fe8-4c36-a566-8760b9278aa0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:45.531653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49c6e-fa19-4d44-b9d3-53bc0a2a8c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:45.532315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49c6e-fa19-4d44-b9d3-53bc0a2a8c52 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:45.532600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49c6e-fa19-4d44-b9d3-53bc0a2a8c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:45.532875 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49c6e-fa19-4d44-b9d3-53bc0a2a8c52 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:45.533582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee49c6e-fa19-4d44-b9d3-53bc0a2a8c52 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:45.533884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee49c6e-fa19-4d44-b9d3-53bc0a2a8c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:45.535270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee49c6e-fa19-4d44-b9d3-53bc0a2a8c52 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:45.544830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 491/984] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:45.545771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5eca8-360f-45ef-8daa-a85304488141 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:45.647440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5eca8-360f-45ef-8daa-a85304488141 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:45.679371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1acd7-e7cf-4482-bd5f-509aab5f5688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:45.680032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1acd7-e7cf-4482-bd5f-509aab5f5688 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:45.680315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1acd7-e7cf-4482-bd5f-509aab5f5688 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:45.680587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1acd7-e7cf-4482-bd5f-509aab5f5688 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:45.681379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1acd7-e7cf-4482-bd5f-509aab5f5688 None admin] RBAC: Adding query filter params (interface=admin, service_id=7d2c08d45f014f1bae200a8fb17301b1, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:45.681687 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1acd7-e7cf-4482-bd5f-509aab5f5688 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:45.683085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1acd7-e7cf-4482-bd5f-509aab5f5688 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:45.688697 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 494/985] 10.222.0.75 () {56 vars in 1249 bytes} [Tue May 17 15:29:45 2022] GET /identity/v3/endpoints?service_id=7d2c08d45f014f1bae200a8fb17301b1&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:45.693970 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49c6e-fa19-4d44-b9d3-53bc0a2a8c52 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:45.777715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3b5b-8c68-40cb-8c83-b60dd75f5110 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:45.778167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3b5b-8c68-40cb-8c83-b60dd75f5110 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:45.778341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3b5b-8c68-40cb-8c83-b60dd75f5110 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:45.779809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 495/986] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:45.784436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b684671-a680-4b85-8c64-126211d43b28 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:45.784719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b684671-a680-4b85-8c64-126211d43b28 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:45.784994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b684671-a680-4b85-8c64-126211d43b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:45.791355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49c6e-fa19-4d44-b9d3-53bc0a2a8c52 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:45.801196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3b684671-a680-4b85-8c64-126211d43b28 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:45.802389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3b684671-a680-4b85-8c64-126211d43b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:45.824224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d00102-cd3e-467d-a6e9-43c0b92bf1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:45.825134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d00102-cd3e-467d-a6e9-43c0b92bf1cf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:45.825634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d00102-cd3e-467d-a6e9-43c0b92bf1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:45.826112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d00102-cd3e-467d-a6e9-43c0b92bf1cf None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:45.827141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d00102-cd3e-467d-a6e9-43c0b92bf1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:45.828694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d00102-cd3e-467d-a6e9-43c0b92bf1cf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:45.835120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 492/987] 10.222.0.75 () {56 vars in 1087 bytes} [Tue May 17 15:29:45 2022] GET /identity/v3/services => generated 1497 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:29:45.886042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 496/988] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:45.904588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d00102-cd3e-467d-a6e9-43c0b92bf1cf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:46.007446 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d00102-cd3e-467d-a6e9-43c0b92bf1cf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:46.040320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77559e-2953-46f2-8658-58183db31d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:46.041003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77559e-2953-46f2-8658-58183db31d4b None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:46.041282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77559e-2953-46f2-8658-58183db31d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:46.041548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77559e-2953-46f2-8658-58183db31d4b None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:46.042327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77559e-2953-46f2-8658-58183db31d4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:46.043741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77559e-2953-46f2-8658-58183db31d4b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:46.059288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 493/989] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:29:45 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:29:47.149810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26c211-5792-4c36-bc58-bf4a625a838b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:47.150282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26c211-5792-4c36-bc58-bf4a625a838b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:47.150395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26c211-5792-4c36-bc58-bf4a625a838b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:47.151786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 497/990] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:47.157521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc8da-04aa-4f03-a2db-8dcc8f99eb33 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:47.157958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc8da-04aa-4f03-a2db-8dcc8f99eb33 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:47.158161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc8da-04aa-4f03-a2db-8dcc8f99eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:47.175197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3a9dc8da-04aa-4f03-a2db-8dcc8f99eb33 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:47.176740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3a9dc8da-04aa-4f03-a2db-8dcc8f99eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:47.253918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 494/991] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:47.274924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26c211-5792-4c36-bc58-bf4a625a838b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:47.370226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26c211-5792-4c36-bc58-bf4a625a838b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:47.402378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea4702-6277-411e-970a-3c153bf6262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:47.403081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea4702-6277-411e-970a-3c153bf6262e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:47.403356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea4702-6277-411e-970a-3c153bf6262e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:47.404177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea4702-6277-411e-970a-3c153bf6262e None admin] PATH_INFO: `/v3/services/image` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:47.404813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea4702-6277-411e-970a-3c153bf6262e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:47.406193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea4702-6277-411e-970a-3c153bf6262e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4fea4702-6277-411e-970a-3c153bf6262e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:47.417200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:47.418197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 15:29:47.419070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:47.422351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 498/992] 10.222.0.75 () {56 vars in 1105 bytes} [Tue May 17 15:29:47 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:47.424234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc8da-04aa-4f03-a2db-8dcc8f99eb33 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:47.517682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc8da-04aa-4f03-a2db-8dcc8f99eb33 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:47.549936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082b2d1-79ec-4656-819d-36a4cb94d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:47.550694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082b2d1-79ec-4656-819d-36a4cb94d530 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:47.550979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082b2d1-79ec-4656-819d-36a4cb94d530 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:47.551254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082b2d1-79ec-4656-819d-36a4cb94d530 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:47.552008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082b2d1-79ec-4656-819d-36a4cb94d530 None admin] RBAC: Adding query filter params (name=image) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:47.552312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082b2d1-79ec-4656-819d-36a4cb94d530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:47.553690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082b2d1-79ec-4656-819d-36a4cb94d530 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:47.562632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 495/993] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:47.563790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea4702-6277-411e-970a-3c153bf6262e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:47.665562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea4702-6277-411e-970a-3c153bf6262e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:47.698860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b7238-cf1a-4230-b99c-af9ced523312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:47.699522 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b7238-cf1a-4230-b99c-af9ced523312 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:47.699807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b7238-cf1a-4230-b99c-af9ced523312 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:47.700082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b7238-cf1a-4230-b99c-af9ced523312 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:47.701452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b7238-cf1a-4230-b99c-af9ced523312 None admin] RBAC: Adding query filter params (type=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:47.701757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b7238-cf1a-4230-b99c-af9ced523312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:47.703159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b7238-cf1a-4230-b99c-af9ced523312 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:47.714047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 499/994] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:48.078262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee2ed6-f6b5-434d-8f6e-4b312cbe4af3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.078602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee2ed6-f6b5-434d-8f6e-4b312cbe4af3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.078796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee2ed6-f6b5-434d-8f6e-4b312cbe4af3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.080289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 496/995] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:48.085303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b48c36-f37a-4094-ac32-1076836b0bf8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.085595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b48c36-f37a-4094-ac32-1076836b0bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.085873 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b48c36-f37a-4094-ac32-1076836b0bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.104049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a4b48c36-f37a-4094-ac32-1076836b0bf8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:48.105311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a4b48c36-f37a-4094-ac32-1076836b0bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:48.181655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 500/996] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:48.205094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee2ed6-f6b5-434d-8f6e-4b312cbe4af3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:48.303677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97f76a-1988-4ad4-aff5-2e3d05aa4dfb None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.303961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97f76a-1988-4ad4-aff5-2e3d05aa4dfb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.304236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97f76a-1988-4ad4-aff5-2e3d05aa4dfb None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.305837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 501/997] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:48.310528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee2ed6-f6b5-434d-8f6e-4b312cbe4af3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:48.311316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d9f66-dcc2-4e35-a924-15adb1d266cb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.311601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d9f66-dcc2-4e35-a924-15adb1d266cb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.311877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d9f66-dcc2-4e35-a924-15adb1d266cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.328020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b31d9f66-dcc2-4e35-a924-15adb1d266cb None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:48.329241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b31d9f66-dcc2-4e35-a924-15adb1d266cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:48.344122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abb8a-4126-4729-8313-c79ceae5c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:48.344923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abb8a-4126-4729-8313-c79ceae5c4ba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.345212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abb8a-4126-4729-8313-c79ceae5c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.345487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abb8a-4126-4729-8313-c79ceae5c4ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.346440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764abb8a-4126-4729-8313-c79ceae5c4ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:48.347793 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764abb8a-4126-4729-8313-c79ceae5c4ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-764abb8a-4126-4729-8313-c79ceae5c4ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:48.359950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:48.366114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:48.367230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 497/998] 10.222.0.75 () {56 vars in 1126 bytes} [Tue May 17 15:29:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:48.368317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abb8a-4126-4729-8313-c79ceae5c4ba None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:48.403125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 502/999] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:48.425797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d9f66-dcc2-4e35-a924-15adb1d266cb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:48.468224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abb8a-4126-4729-8313-c79ceae5c4ba None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:48.504464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b66da-09de-45ac-86b9-ed333a81d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:48.505129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b66da-09de-45ac-86b9-ed333a81d20c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.505421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b66da-09de-45ac-86b9-ed333a81d20c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.505693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b66da-09de-45ac-86b9-ed333a81d20c None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.506438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b66da-09de-45ac-86b9-ed333a81d20c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:48.506745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b66da-09de-45ac-86b9-ed333a81d20c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:48.508104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b66da-09de-45ac-86b9-ed333a81d20c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:48.517549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 498/1000] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:48.518609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b66da-09de-45ac-86b9-ed333a81d20c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:48.535197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d9f66-dcc2-4e35-a924-15adb1d266cb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:48.569312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb971b-61af-4d63-bc1c-d519c2ae0a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:48.570128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb971b-61af-4d63-bc1c-d519c2ae0a44 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.570414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb971b-61af-4d63-bc1c-d519c2ae0a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.570691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb971b-61af-4d63-bc1c-d519c2ae0a44 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.571339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb971b-61af-4d63-bc1c-d519c2ae0a44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:48.572711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb971b-61af-4d63-bc1c-d519c2ae0a44 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e4bb971b-61af-4d63-bc1c-d519c2ae0a44 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:48.584605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:48.585794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:48.586826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 503/1001] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:48.592187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb971b-61af-4d63-bc1c-d519c2ae0a44 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:48.617992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b66da-09de-45ac-86b9-ed333a81d20c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:48.653966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65d546-5179-4fc2-a7e4-c92b022d867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:48.654732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d546-5179-4fc2-a7e4-c92b022d867e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.655083 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d546-5179-4fc2-a7e4-c92b022d867e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.655430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d546-5179-4fc2-a7e4-c92b022d867e None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.656203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65d546-5179-4fc2-a7e4-c92b022d867e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:48.656580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65d546-5179-4fc2-a7e4-c92b022d867e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:48.658045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65d546-5179-4fc2-a7e4-c92b022d867e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:48.662744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 499/1002] 10.222.0.75 () {56 vars in 1122 bytes} [Tue May 17 15:29:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:48.668212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65d546-5179-4fc2-a7e4-c92b022d867e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:48.692691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb971b-61af-4d63-bc1c-d519c2ae0a44 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:48.726061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4cf3a-4f07-4945-8755-7a1aafcaa3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:48.726725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4cf3a-4f07-4945-8755-7a1aafcaa3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.727007 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4cf3a-4f07-4945-8755-7a1aafcaa3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.727279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4cf3a-4f07-4945-8755-7a1aafcaa3a3 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.727977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4cf3a-4f07-4945-8755-7a1aafcaa3a3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:48.728279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4cf3a-4f07-4945-8755-7a1aafcaa3a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:48.729643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4cf3a-4f07-4945-8755-7a1aafcaa3a3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:48.735208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 504/1003] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:48.740528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4cf3a-4f07-4945-8755-7a1aafcaa3a3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:48.770061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65d546-5179-4fc2-a7e4-c92b022d867e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:48.805150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606d7e1-ed01-4fc2-b909-2efc1f524372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:48.805806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606d7e1-ed01-4fc2-b909-2efc1f524372 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.806117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606d7e1-ed01-4fc2-b909-2efc1f524372 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.806394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606d7e1-ed01-4fc2-b909-2efc1f524372 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.807131 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606d7e1-ed01-4fc2-b909-2efc1f524372 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:48.808502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606d7e1-ed01-4fc2-b909-2efc1f524372 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:48.834040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 500/1004] 10.222.0.75 () {60 vars in 1144 bytes} [Tue May 17 15:29:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:48.855295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4cf3a-4f07-4945-8755-7a1aafcaa3a3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:48.898352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a963e-3542-4334-a343-a1919b297b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:48.899127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a963e-3542-4334-a343-a1919b297b32 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:48.899469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a963e-3542-4334-a343-a1919b297b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:48.899809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a963e-3542-4334-a343-a1919b297b32 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:48.900583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a963e-3542-4334-a343-a1919b297b32 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:48.900961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a963e-3542-4334-a343-a1919b297b32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:48.902485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a963e-3542-4334-a343-a1919b297b32 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:48.913444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 505/1005] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:48.915203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606d7e1-ed01-4fc2-b909-2efc1f524372 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:49.018587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606d7e1-ed01-4fc2-b909-2efc1f524372 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:49.052004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91efd6-a0ba-4a69-89f5-90541bcc650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:49.052655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91efd6-a0ba-4a69-89f5-90541bcc650e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:49.052934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91efd6-a0ba-4a69-89f5-90541bcc650e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:49.053200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91efd6-a0ba-4a69-89f5-90541bcc650e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:49.053980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91efd6-a0ba-4a69-89f5-90541bcc650e None admin] RBAC: Adding query filter params (interface=public, service_id=099998e37c7644fa99d6e0e7033e53b0, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:49.054317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91efd6-a0ba-4a69-89f5-90541bcc650e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:49.055676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91efd6-a0ba-4a69-89f5-90541bcc650e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:49.061249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 501/1006] 10.222.0.75 () {56 vars in 1251 bytes} [Tue May 17 15:29:48 2022] GET /identity/v3/endpoints?service_id=099998e37c7644fa99d6e0e7033e53b0&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:49.066754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a963e-3542-4334-a343-a1919b297b32 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:49.163804 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a963e-3542-4334-a343-a1919b297b32 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:49.196345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518a721-c1bd-4e5b-a6ba-2c6bcfc59ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:49.197101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a721-c1bd-4e5b-a6ba-2c6bcfc59ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:49.197378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a721-c1bd-4e5b-a6ba-2c6bcfc59ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:49.197658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a721-c1bd-4e5b-a6ba-2c6bcfc59ed6 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:49.198364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518a721-c1bd-4e5b-a6ba-2c6bcfc59ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:49.199739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518a721-c1bd-4e5b-a6ba-2c6bcfc59ed6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:49.205992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 506/1007] 10.222.0.75 () {56 vars in 1087 bytes} [Tue May 17 15:29:49 2022] GET /identity/v3/services => generated 1727 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:29:49.951075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a323-7ae4-4919-a934-f1fbe0155641 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:49.951637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a323-7ae4-4919-a934-f1fbe0155641 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:49.951637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a323-7ae4-4919-a934-f1fbe0155641 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:49.953015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 502/1008] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:49.958639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049d583-a476-4548-a776-dd4baf2bd943 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:49.958999 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049d583-a476-4548-a776-dd4baf2bd943 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:49.959204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049d583-a476-4548-a776-dd4baf2bd943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:49.976564 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7049d583-a476-4548-a776-dd4baf2bd943 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:49.977742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7049d583-a476-4548-a776-dd4baf2bd943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:50.041793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 507/1009] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:50.064421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a323-7ae4-4919-a934-f1fbe0155641 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:50.174762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a323-7ae4-4919-a934-f1fbe0155641 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:50.207167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00beb3-020f-4919-ad59-57560d7f7992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:50.207991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00beb3-020f-4919-ad59-57560d7f7992 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:50.208437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00beb3-020f-4919-ad59-57560d7f7992 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:50.208855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00beb3-020f-4919-ad59-57560d7f7992 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:50.209714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00beb3-020f-4919-ad59-57560d7f7992 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:50.211253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00beb3-020f-4919-ad59-57560d7f7992 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:50.226091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 503/1010] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:29:50 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:51.073638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b750-f62d-4e98-a6df-0f1d6299c353 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:51.074181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b750-f62d-4e98-a6df-0f1d6299c353 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:51.074259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b750-f62d-4e98-a6df-0f1d6299c353 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:51.075643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 508/1011] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:51.080816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f72b-9abf-411f-abe6-0f1600558d55 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:51.081233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f72b-9abf-411f-abe6-0f1600558d55 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:51.081400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f72b-9abf-411f-abe6-0f1600558d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:51.098256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-59c4f72b-9abf-411f-abe6-0f1600558d55 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:51.099440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-59c4f72b-9abf-411f-abe6-0f1600558d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:51.170809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 504/1012] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:51 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:51.193631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b750-f62d-4e98-a6df-0f1d6299c353 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:51.298638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b750-f62d-4e98-a6df-0f1d6299c353 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:51.330683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32155f8-610a-4e35-bc03-8ef18833e0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:51.331382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32155f8-610a-4e35-bc03-8ef18833e0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:51.331658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32155f8-610a-4e35-bc03-8ef18833e0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:51.331924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32155f8-610a-4e35-bc03-8ef18833e0a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:51.333067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32155f8-610a-4e35-bc03-8ef18833e0a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:51.334514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32155f8-610a-4e35-bc03-8ef18833e0a9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:51.336250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 509/1013] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:51.342323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4f72b-9abf-411f-abe6-0f1600558d55 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:51.438078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4f72b-9abf-411f-abe6-0f1600558d55 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:51.456271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397875c-8a42-4ba2-8af9-1658a12e7769 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:51.456577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397875c-8a42-4ba2-8af9-1658a12e7769 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:51.456831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397875c-8a42-4ba2-8af9-1658a12e7769 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:51.458350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 510/1014] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:51.463261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a3c42-ff54-417b-a7a8-cc1614665e9c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:51.463549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a3c42-ff54-417b-a7a8-cc1614665e9c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:51.463828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a3c42-ff54-417b-a7a8-cc1614665e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:51.471524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65ba3-a7e6-4e9d-a2b2-9aa87d7aca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:51.472182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65ba3-a7e6-4e9d-a2b2-9aa87d7aca63 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:51.472460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65ba3-a7e6-4e9d-a2b2-9aa87d7aca63 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:51.472730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65ba3-a7e6-4e9d-a2b2-9aa87d7aca63 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:51.473434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c65ba3-a7e6-4e9d-a2b2-9aa87d7aca63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:51.474878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c65ba3-a7e6-4e9d-a2b2-9aa87d7aca63 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:51.480219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a09a3c42-ff54-417b-a7a8-cc1614665e9c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:51.481437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a09a3c42-ff54-417b-a7a8-cc1614665e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:51.501923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 505/1015] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:29:51 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:51.552405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 511/1016] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:51 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:51.575254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65ba3-a7e6-4e9d-a2b2-9aa87d7aca63 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:51.678904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65ba3-a7e6-4e9d-a2b2-9aa87d7aca63 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:51.713215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405a4bc-4406-442a-ae8d-1dff620e5e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:51.713691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405a4bc-4406-442a-ae8d-1dff620e5e8c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:51.714541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405a4bc-4406-442a-ae8d-1dff620e5e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:51.714541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405a4bc-4406-442a-ae8d-1dff620e5e8c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:51.714924 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405a4bc-4406-442a-ae8d-1dff620e5e8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:51.716849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405a4bc-4406-442a-ae8d-1dff620e5e8c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6405a4bc-4406-442a-ae8d-1dff620e5e8c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:51.728648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:51.729637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:51.730532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 506/1017] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:51.736828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a3c42-ff54-417b-a7a8-cc1614665e9c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:51.832646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a3c42-ff54-417b-a7a8-cc1614665e9c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:51.865366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391866e8-b9c0-4cf7-ad80-56a6ec737847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:51.866372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391866e8-b9c0-4cf7-ad80-56a6ec737847 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:51.866650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391866e8-b9c0-4cf7-ad80-56a6ec737847 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:51.866920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391866e8-b9c0-4cf7-ad80-56a6ec737847 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:51.867619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391866e8-b9c0-4cf7-ad80-56a6ec737847 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:51.867920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391866e8-b9c0-4cf7-ad80-56a6ec737847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:51.869283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391866e8-b9c0-4cf7-ad80-56a6ec737847 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:51.874169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 512/1018] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:51.879869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405a4bc-4406-442a-ae8d-1dff620e5e8c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:51.975414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405a4bc-4406-442a-ae8d-1dff620e5e8c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:52.006508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de294fa9-95e4-407f-a8c2-60513f404d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:52.007168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294fa9-95e4-407f-a8c2-60513f404d3f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:52.007448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294fa9-95e4-407f-a8c2-60513f404d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:52.007717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294fa9-95e4-407f-a8c2-60513f404d3f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:52.008417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de294fa9-95e4-407f-a8c2-60513f404d3f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:52.008720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de294fa9-95e4-407f-a8c2-60513f404d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:52.010111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de294fa9-95e4-407f-a8c2-60513f404d3f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:52.015496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 507/1019] 10.222.0.75 () {56 vars in 1112 bytes} [Tue May 17 15:29:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:52.020875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391866e8-b9c0-4cf7-ad80-56a6ec737847 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:52.116284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391866e8-b9c0-4cf7-ad80-56a6ec737847 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:52.148780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92639b0-098d-42eb-8e86-5b09c9da2959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:52.149441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92639b0-098d-42eb-8e86-5b09c9da2959 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:52.149720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92639b0-098d-42eb-8e86-5b09c9da2959 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:52.150012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92639b0-098d-42eb-8e86-5b09c9da2959 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:52.150766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92639b0-098d-42eb-8e86-5b09c9da2959 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:52.152150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92639b0-098d-42eb-8e86-5b09c9da2959 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:52.178022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 513/1020] 10.222.0.75 () {60 vars in 1144 bytes} [Tue May 17 15:29:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:52.468426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1623d1d-c223-4f6b-9165-84f3f6d31711 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:52.468936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1623d1d-c223-4f6b-9165-84f3f6d31711 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:52.469023 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1623d1d-c223-4f6b-9165-84f3f6d31711 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:52.470345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 508/1021] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:52.475780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0ffd-34aa-45c1-8dfc-0b20f0c6a6b8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:52.476067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0ffd-34aa-45c1-8dfc-0b20f0c6a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:52.476344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0ffd-34aa-45c1-8dfc-0b20f0c6a6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:52.492594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-889a0ffd-34aa-45c1-8dfc-0b20f0c6a6b8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:52.493755 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-889a0ffd-34aa-45c1-8dfc-0b20f0c6a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:52.563774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 514/1022] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:52.585277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1623d1d-c223-4f6b-9165-84f3f6d31711 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:52.686483 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1623d1d-c223-4f6b-9165-84f3f6d31711 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:52.717545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959e107-8504-481b-bbd6-265e644ff5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:52.718352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959e107-8504-481b-bbd6-265e644ff5ff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:52.718681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959e107-8504-481b-bbd6-265e644ff5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:52.718893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959e107-8504-481b-bbd6-265e644ff5ff None admin] PATH_INFO: `/v3/services/image` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:52.719531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959e107-8504-481b-bbd6-265e644ff5ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:52.721139 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959e107-8504-481b-bbd6-265e644ff5ff None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8959e107-8504-481b-bbd6-265e644ff5ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:52.732798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:52.733784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 15:29:52.734673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:52.736159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 509/1023] 10.222.0.75 () {56 vars in 1105 bytes} [Tue May 17 15:29:52 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:52.740127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a0ffd-34aa-45c1-8dfc-0b20f0c6a6b8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:52.838726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a0ffd-34aa-45c1-8dfc-0b20f0c6a6b8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:52.870746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c1717-07bb-4251-bdf6-c388caa18b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:52.871403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c1717-07bb-4251-bdf6-c388caa18b59 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:52.871706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c1717-07bb-4251-bdf6-c388caa18b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:52.871994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c1717-07bb-4251-bdf6-c388caa18b59 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:52.873179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c1717-07bb-4251-bdf6-c388caa18b59 None admin] RBAC: Adding query filter params (name=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:52.873476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c1717-07bb-4251-bdf6-c388caa18b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:52.874850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c1717-07bb-4251-bdf6-c388caa18b59 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:52.879710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 515/1024] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:52.885028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959e107-8504-481b-bbd6-265e644ff5ff None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:52.977520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959e107-8504-481b-bbd6-265e644ff5ff None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:53.008698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3fd43-0781-4baf-88ed-7da53b6365ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:53.009350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3fd43-0781-4baf-88ed-7da53b6365ff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:53.009628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3fd43-0781-4baf-88ed-7da53b6365ff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:53.009897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3fd43-0781-4baf-88ed-7da53b6365ff None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:53.010684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3fd43-0781-4baf-88ed-7da53b6365ff None admin] RBAC: Adding query filter params (type=image) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:53.010987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3fd43-0781-4baf-88ed-7da53b6365ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:53.012324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3fd43-0781-4baf-88ed-7da53b6365ff None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:53.021858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 510/1025] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:53.023117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c1717-07bb-4251-bdf6-c388caa18b59 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:53.117890 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c1717-07bb-4251-bdf6-c388caa18b59 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:53.150094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48f105-5fe2-4f97-b6ab-5aa2109d48f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:53.150764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48f105-5fe2-4f97-b6ab-5aa2109d48f9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:53.151049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48f105-5fe2-4f97-b6ab-5aa2109d48f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:53.151323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48f105-5fe2-4f97-b6ab-5aa2109d48f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:53.152111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48f105-5fe2-4f97-b6ab-5aa2109d48f9 None admin] RBAC: Adding query filter params (interface=public, service_id=732fe573a08c4261a31ee9cb17d7da1f, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:53.152418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48f105-5fe2-4f97-b6ab-5aa2109d48f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:53.154323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48f105-5fe2-4f97-b6ab-5aa2109d48f9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:53.163571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 516/1026] 10.222.0.75 () {56 vars in 1251 bytes} [Tue May 17 15:29:53 2022] GET /identity/v3/endpoints?service_id=732fe573a08c4261a31ee9cb17d7da1f&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:53.164801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3fd43-0781-4baf-88ed-7da53b6365ff None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:53.261067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3fd43-0781-4baf-88ed-7da53b6365ff None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:53.299040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e7a79-fd17-4d43-bd02-ca35e18e8424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:53.299705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e7a79-fd17-4d43-bd02-ca35e18e8424 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:53.299989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e7a79-fd17-4d43-bd02-ca35e18e8424 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:53.300267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e7a79-fd17-4d43-bd02-ca35e18e8424 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:53.300948 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e7a79-fd17-4d43-bd02-ca35e18e8424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:53.302336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e7a79-fd17-4d43-bd02-ca35e18e8424 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:53.314235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 511/1027] 10.222.0.75 () {56 vars in 1087 bytes} [Tue May 17 15:29:53 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:29:53.769426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23bfef-399a-40ff-afdc-629cb9419e0e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:53.769764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23bfef-399a-40ff-afdc-629cb9419e0e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:53.769961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23bfef-399a-40ff-afdc-629cb9419e0e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:53.771555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 517/1028] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:53.776450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d8df4-92bd-49fd-9ab7-cba6c755a0e5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:53.776881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d8df4-92bd-49fd-9ab7-cba6c755a0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:53.777043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d8df4-92bd-49fd-9ab7-cba6c755a0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:53.793123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-922d8df4-92bd-49fd-9ab7-cba6c755a0e5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:53.794345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-922d8df4-92bd-49fd-9ab7-cba6c755a0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:53.859225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 512/1029] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:53.883950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23bfef-399a-40ff-afdc-629cb9419e0e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:53.979528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23bfef-399a-40ff-afdc-629cb9419e0e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:54.011673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a3e7-0c2c-4b42-80d9-da6b7a30209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:54.012456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a3e7-0c2c-4b42-80d9-da6b7a30209a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:54.012764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a3e7-0c2c-4b42-80d9-da6b7a30209a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:54.013029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a3e7-0c2c-4b42-80d9-da6b7a30209a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:54.014213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06a3e7-0c2c-4b42-80d9-da6b7a30209a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:54.015644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06a3e7-0c2c-4b42-80d9-da6b7a30209a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:54.021966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 518/1030] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:54.023036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d8df4-92bd-49fd-9ab7-cba6c755a0e5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:54.116774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d8df4-92bd-49fd-9ab7-cba6c755a0e5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:54.149179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9156e3-7b0e-4cf5-a2dd-508ede123474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:54.149848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9156e3-7b0e-4cf5-a2dd-508ede123474 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:54.150153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9156e3-7b0e-4cf5-a2dd-508ede123474 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:54.150423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9156e3-7b0e-4cf5-a2dd-508ede123474 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:54.151123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9156e3-7b0e-4cf5-a2dd-508ede123474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:54.152536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9156e3-7b0e-4cf5-a2dd-508ede123474 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:54.177867 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 513/1031] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:29:54 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:29:54.513987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada021d-1d69-4790-93a4-30c80d9d00b2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:54.514521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada021d-1d69-4790-93a4-30c80d9d00b2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:54.514600 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada021d-1d69-4790-93a4-30c80d9d00b2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:54.515911 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 519/1032] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:54.521526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242a4e-552e-4e0d-a5c7-efeeddf19c37 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:54.521819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242a4e-552e-4e0d-a5c7-efeeddf19c37 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:54.522185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242a4e-552e-4e0d-a5c7-efeeddf19c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:54.538947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-64242a4e-552e-4e0d-a5c7-efeeddf19c37 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:54.540126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-64242a4e-552e-4e0d-a5c7-efeeddf19c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:54.604901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 514/1033] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:54.628969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada021d-1d69-4790-93a4-30c80d9d00b2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:54.726056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada021d-1d69-4790-93a4-30c80d9d00b2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:54.758759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700ddd6-26c8-4725-aee0-83a3b48ffa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:54.759568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700ddd6-26c8-4725-aee0-83a3b48ffa27 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:54.759848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700ddd6-26c8-4725-aee0-83a3b48ffa27 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:54.760118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700ddd6-26c8-4725-aee0-83a3b48ffa27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:54.769953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700ddd6-26c8-4725-aee0-83a3b48ffa27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4700ddd6-26c8-4725-aee0-83a3b48ffa27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:54.777900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:54.779476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:54.780339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:54.782367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 520/1034] 10.222.0.75 () {56 vars in 1120 bytes} [Tue May 17 15:29:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:54.785435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242a4e-552e-4e0d-a5c7-efeeddf19c37 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:54.878792 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242a4e-552e-4e0d-a5c7-efeeddf19c37 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:54.920712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954fc4d-425a-419a-8fe0-7054e615e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:54.921379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954fc4d-425a-419a-8fe0-7054e615e712 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:54.921659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954fc4d-425a-419a-8fe0-7054e615e712 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:54.922067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954fc4d-425a-419a-8fe0-7054e615e712 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:54.922821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954fc4d-425a-419a-8fe0-7054e615e712 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:54.923177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954fc4d-425a-419a-8fe0-7054e615e712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:54.924577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954fc4d-425a-419a-8fe0-7054e615e712 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:54.937108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 515/1035] 10.222.0.75 () {56 vars in 1115 bytes} [Tue May 17 15:29:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:54.938732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700ddd6-26c8-4725-aee0-83a3b48ffa27 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:55.034925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700ddd6-26c8-4725-aee0-83a3b48ffa27 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:55.066637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8a665-ff1e-4269-b4b1-767ee745b361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:55.067431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a665-ff1e-4269-b4b1-767ee745b361 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:55.067712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a665-ff1e-4269-b4b1-767ee745b361 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:55.067983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a665-ff1e-4269-b4b1-767ee745b361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:55.078889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8a665-ff1e-4269-b4b1-767ee745b361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:55.080327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8a665-ff1e-4269-b4b1-767ee745b361 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-43c8a665-ff1e-4269-b4b1-767ee745b361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:55.097888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:55.099106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:55.100018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:55.100018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:55.100018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:55.100018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:55.103727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 521/1036] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:55.105123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954fc4d-425a-419a-8fe0-7054e615e712 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:55.202341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954fc4d-425a-419a-8fe0-7054e615e712 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:55.236754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76562dc-5627-427d-8c39-b732441bcc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:55.237418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76562dc-5627-427d-8c39-b732441bcc23 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:55.237699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76562dc-5627-427d-8c39-b732441bcc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:55.237970 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76562dc-5627-427d-8c39-b732441bcc23 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:55.238718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76562dc-5627-427d-8c39-b732441bcc23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:55.239020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76562dc-5627-427d-8c39-b732441bcc23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:55.240369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76562dc-5627-427d-8c39-b732441bcc23 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:55.256775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 516/1037] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:55.258529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8a665-ff1e-4269-b4b1-767ee745b361 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:55.368492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8a665-ff1e-4269-b4b1-767ee745b361 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:55.402712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def470cf-4ae5-43f9-86b8-2373860a0989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:55.403544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def470cf-4ae5-43f9-86b8-2373860a0989 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:55.403820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def470cf-4ae5-43f9-86b8-2373860a0989 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:55.404090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def470cf-4ae5-43f9-86b8-2373860a0989 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:55.411518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def470cf-4ae5-43f9-86b8-2373860a0989 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:55.412948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def470cf-4ae5-43f9-86b8-2373860a0989 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-def470cf-4ae5-43f9-86b8-2373860a0989 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:55.426611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:55.427706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:55.428682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:55.430084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 522/1038] 10.222.0.75 () {56 vars in 1093 bytes} [Tue May 17 15:29:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:55.433830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76562dc-5627-427d-8c39-b732441bcc23 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:55.513375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033db6d9-aca4-4092-8a7b-36ae650b29e9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:55.513689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033db6d9-aca4-4092-8a7b-36ae650b29e9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:55.513913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033db6d9-aca4-4092-8a7b-36ae650b29e9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:55.515462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 523/1039] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:55.520203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73841850-636d-41f1-8284-842d703fbbfb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:55.520484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73841850-636d-41f1-8284-842d703fbbfb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:55.520756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73841850-636d-41f1-8284-842d703fbbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:55.531500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76562dc-5627-427d-8c39-b732441bcc23 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:55.536975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-73841850-636d-41f1-8284-842d703fbbfb None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:55.538242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-73841850-636d-41f1-8284-842d703fbbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:55.564892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ffcb-12fa-48ca-99c5-0f87f8fa64a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:55.565553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ffcb-12fa-48ca-99c5-0f87f8fa64a0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:55.565836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ffcb-12fa-48ca-99c5-0f87f8fa64a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:55.566142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ffcb-12fa-48ca-99c5-0f87f8fa64a0 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:55.566971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175ffcb-12fa-48ca-99c5-0f87f8fa64a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:55.567276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175ffcb-12fa-48ca-99c5-0f87f8fa64a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:55.568686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175ffcb-12fa-48ca-99c5-0f87f8fa64a0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:55.589679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 517/1040] 10.222.0.75 () {56 vars in 1133 bytes} [Tue May 17 15:29:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:55.591412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ffcb-12fa-48ca-99c5-0f87f8fa64a0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:55.604724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 524/1041] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:55.629344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73841850-636d-41f1-8284-842d703fbbfb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:55.688796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ffcb-12fa-48ca-99c5-0f87f8fa64a0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:55.720531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab33c7b-1dff-4c55-bf4a-986fda6fc5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:55.721432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab33c7b-1dff-4c55-bf4a-986fda6fc5bc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:55.721714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab33c7b-1dff-4c55-bf4a-986fda6fc5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:55.721987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab33c7b-1dff-4c55-bf4a-986fda6fc5bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:55.728130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73841850-636d-41f1-8284-842d703fbbfb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:55.765073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb00f8c-6162-4a12-b0ef-48ba78ee483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:55.765857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb00f8c-6162-4a12-b0ef-48ba78ee483e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:55.766174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb00f8c-6162-4a12-b0ef-48ba78ee483e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:55.766457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb00f8c-6162-4a12-b0ef-48ba78ee483e None admin] PATH_INFO: `/v3/services/image` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:55.767103 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb00f8c-6162-4a12-b0ef-48ba78ee483e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:55.768479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb00f8c-6162-4a12-b0ef-48ba78ee483e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-2fb00f8c-6162-4a12-b0ef-48ba78ee483e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:55.780031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:55.781223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:55.782712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 525/1042] 10.222.0.75 () {56 vars in 1105 bytes} [Tue May 17 15:29:55 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:55.787099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb00f8c-6162-4a12-b0ef-48ba78ee483e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:55.791982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab33c7b-1dff-4c55-bf4a-986fda6fc5bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:55.793427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab33c7b-1dff-4c55-bf4a-986fda6fc5bc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:55.885198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb00f8c-6162-4a12-b0ef-48ba78ee483e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:55.891732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 518/1043] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 15:29:55.897499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab33c7b-1dff-4c55-bf4a-986fda6fc5bc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:55.922430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa5441-c320-46b6-8722-ec218514f760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:55.923094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa5441-c320-46b6-8722-ec218514f760 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:55.923427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa5441-c320-46b6-8722-ec218514f760 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:55.923704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa5441-c320-46b6-8722-ec218514f760 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:55.924453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa5441-c320-46b6-8722-ec218514f760 None admin] RBAC: Adding query filter params (name=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:55.924768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa5441-c320-46b6-8722-ec218514f760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:55.926139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa5441-c320-46b6-8722-ec218514f760 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:55.931275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 526/1044] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:55.937135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa5441-c320-46b6-8722-ec218514f760 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:55.996044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab33c7b-1dff-4c55-bf4a-986fda6fc5bc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:56.030702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb461dc-95f8-4358-b8e4-85dc595ba61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:56.031596 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb461dc-95f8-4358-b8e4-85dc595ba61c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.031877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb461dc-95f8-4358-b8e4-85dc595ba61c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.032153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb461dc-95f8-4358-b8e4-85dc595ba61c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.033023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa5441-c320-46b6-8722-ec218514f760 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:56.042156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb461dc-95f8-4358-b8e4-85dc595ba61c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:56.043661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb461dc-95f8-4358-b8e4-85dc595ba61c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-7cb461dc-95f8-4358-b8e4-85dc595ba61c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:56.061890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:56.063080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:56.064203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:56.064203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:56.064203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:56.064203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:56.067717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 519/1045] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:56.068592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb461dc-95f8-4358-b8e4-85dc595ba61c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:56.068802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9f807-838f-4d0c-9b49-15792f177fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:56.069468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9f807-838f-4d0c-9b49-15792f177fcf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.069753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9f807-838f-4d0c-9b49-15792f177fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.070056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9f807-838f-4d0c-9b49-15792f177fcf None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.070761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9f807-838f-4d0c-9b49-15792f177fcf None admin] RBAC: Adding query filter params (type=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:56.071069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9f807-838f-4d0c-9b49-15792f177fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:56.072436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9f807-838f-4d0c-9b49-15792f177fcf None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:56.081881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 527/1046] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:56.082721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9f807-838f-4d0c-9b49-15792f177fcf None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:56.166714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb461dc-95f8-4358-b8e4-85dc595ba61c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:56.183182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9f807-838f-4d0c-9b49-15792f177fcf None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:56.199120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa851e84-33f5-4a62-a0c1-43bda2e0aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:56.199779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa851e84-33f5-4a62-a0c1-43bda2e0aa09 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.200057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa851e84-33f5-4a62-a0c1-43bda2e0aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.200327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa851e84-33f5-4a62-a0c1-43bda2e0aa09 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.201036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa851e84-33f5-4a62-a0c1-43bda2e0aa09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:56.201339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa851e84-33f5-4a62-a0c1-43bda2e0aa09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:56.202723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa851e84-33f5-4a62-a0c1-43bda2e0aa09 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:56.214040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 520/1047] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:56.219805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa851e84-33f5-4a62-a0c1-43bda2e0aa09 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:56.221855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a958c-dd90-4daa-8a11-14dabbb51895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:56.222555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a958c-dd90-4daa-8a11-14dabbb51895 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.222810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a958c-dd90-4daa-8a11-14dabbb51895 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.223082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a958c-dd90-4daa-8a11-14dabbb51895 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.223984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a958c-dd90-4daa-8a11-14dabbb51895 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:56.225139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a958c-dd90-4daa-8a11-14dabbb51895 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:56.254882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 528/1048] 10.222.0.75 () {60 vars in 1144 bytes} [Tue May 17 15:29:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:29:56.337286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa851e84-33f5-4a62-a0c1-43bda2e0aa09 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:56.378191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02884-6ec2-40f6-9b83-80d71b5561fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:56.378995 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02884-6ec2-40f6-9b83-80d71b5561fb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.379271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02884-6ec2-40f6-9b83-80d71b5561fb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.379540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02884-6ec2-40f6-9b83-80d71b5561fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.386928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa02884-6ec2-40f6-9b83-80d71b5561fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:56.388966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa02884-6ec2-40f6-9b83-80d71b5561fb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2aa02884-6ec2-40f6-9b83-80d71b5561fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:29:56.405047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:56.406060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:56.407003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:29:56.407003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:29:56.407003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:29:56.407003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:29:56.407003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:29:56.407003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:29:56.407003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:29:56.407003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:56.407003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 521/1049] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:56.412215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a958c-dd90-4daa-8a11-14dabbb51895 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:56.490807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1c5f4-9cf2-4fba-91b2-7ed780918674 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.491150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1c5f4-9cf2-4fba-91b2-7ed780918674 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.491354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1c5f4-9cf2-4fba-91b2-7ed780918674 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.492896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 522/1050] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:56.497692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3f8d-397f-40ee-9e26-13c0634b9a3c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.497977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3f8d-397f-40ee-9e26-13c0634b9a3c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.498300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3f8d-397f-40ee-9e26-13c0634b9a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.515595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a958c-dd90-4daa-8a11-14dabbb51895 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:56.517184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3aac3f8d-397f-40ee-9e26-13c0634b9a3c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:56.518419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3aac3f8d-397f-40ee-9e26-13c0634b9a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:56.548275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bb85b-390b-4725-9eb4-531a2d69a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:56.548934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bb85b-390b-4725-9eb4-531a2d69a573 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.549222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bb85b-390b-4725-9eb4-531a2d69a573 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.549488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bb85b-390b-4725-9eb4-531a2d69a573 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.550277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bb85b-390b-4725-9eb4-531a2d69a573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:56.550587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bb85b-390b-4725-9eb4-531a2d69a573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:56.551997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bb85b-390b-4725-9eb4-531a2d69a573 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:56.563761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 529/1051] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:56.569344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bb85b-390b-4725-9eb4-531a2d69a573 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:56.583652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 523/1052] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:56.607192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac3f8d-397f-40ee-9e26-13c0634b9a3c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:56.663262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bb85b-390b-4725-9eb4-531a2d69a573 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:56.696109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5fc0-a7e5-4779-9ea8-426521036f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:56.696744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5fc0-a7e5-4779-9ea8-426521036f5b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.697044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5fc0-a7e5-4779-9ea8-426521036f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.697418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5fc0-a7e5-4779-9ea8-426521036f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.698387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5fc0-a7e5-4779-9ea8-426521036f5b None admin] RBAC: Adding query filter params (role.id=90070bf28cac41abaa6ce1d3935dfad3, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8ef90c1c9c784d8792b3afe6e8e7fb31) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:56.698829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5fc0-a7e5-4779-9ea8-426521036f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:56.700758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5fc0-a7e5-4779-9ea8-426521036f5b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:56.701393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac3f8d-397f-40ee-9e26-13c0634b9a3c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:56.706563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 530/1053] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:56 2022] GET /identity/v3/role_assignments?user.id=8ef90c1c9c784d8792b3afe6e8e7fb31&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=90070bf28cac41abaa6ce1d3935dfad3 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:56.736590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3353c9-a6ca-4ea5-9bd8-7cb3b45c7236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:56.737400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3353c9-a6ca-4ea5-9bd8-7cb3b45c7236 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.737677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3353c9-a6ca-4ea5-9bd8-7cb3b45c7236 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.737947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3353c9-a6ca-4ea5-9bd8-7cb3b45c7236 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.750033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3353c9-a6ca-4ea5-9bd8-7cb3b45c7236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-eb3353c9-a6ca-4ea5-9bd8-7cb3b45c7236 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:56.757625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:56.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:56.759864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 524/1054] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:29:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:56.767425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5fc0-a7e5-4779-9ea8-426521036f5b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:56.873834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5fc0-a7e5-4779-9ea8-426521036f5b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:56.908393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e681d-9567-489e-afe7-78ccfae2d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:56.909125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e681d-9567-489e-afe7-78ccfae2d08e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:56.909413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e681d-9567-489e-afe7-78ccfae2d08e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:56.909688 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e681d-9567-489e-afe7-78ccfae2d08e None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:56.910461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e681d-9567-489e-afe7-78ccfae2d08e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:56.910769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e681d-9567-489e-afe7-78ccfae2d08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:56.912144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e681d-9567-489e-afe7-78ccfae2d08e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:56.920442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 531/1055] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:29:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:56.926243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3353c9-a6ca-4ea5-9bd8-7cb3b45c7236 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:57.027535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3353c9-a6ca-4ea5-9bd8-7cb3b45c7236 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:57.059908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b213f-9965-4735-b8c4-c902e3ffeaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:57.060768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b213f-9965-4735-b8c4-c902e3ffeaff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:57.061046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b213f-9965-4735-b8c4-c902e3ffeaff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:57.061311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b213f-9965-4735-b8c4-c902e3ffeaff None admin] PATH_INFO: `/v3/users/f3090e6b638b4f399d7ae308ef632d42` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:57.074226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b213f-9965-4735-b8c4-c902e3ffeaff None admin] RBAC: Authorizing `identity:get_user(user_id=f3090e6b638b4f399d7ae308ef632d42)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:57.076175 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b213f-9965-4735-b8c4-c902e3ffeaff None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:57.082497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 525/1056] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:29:56 2022] GET /identity/v3/users/f3090e6b638b4f399d7ae308ef632d42 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:57.083605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e681d-9567-489e-afe7-78ccfae2d08e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:57.182935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e681d-9567-489e-afe7-78ccfae2d08e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:57.215811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ffff-40c6-4084-8040-c63e526de6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:57.216454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ffff-40c6-4084-8040-c63e526de6df None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:57.216732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ffff-40c6-4084-8040-c63e526de6df None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:57.217002 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ffff-40c6-4084-8040-c63e526de6df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:57.283056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954ffff-40c6-4084-8040-c63e526de6df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:57.284499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954ffff-40c6-4084-8040-c63e526de6df None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:57.384805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 532/1057] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:29:57.386063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b213f-9965-4735-b8c4-c902e3ffeaff None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:57.482376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b213f-9965-4735-b8c4-c902e3ffeaff None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:57.513832 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292c03a-5369-4723-9187-573ca9e4ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:57.514703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c03a-5369-4723-9187-573ca9e4ee4d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:57.514978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c03a-5369-4723-9187-573ca9e4ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:57.515248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c03a-5369-4723-9187-573ca9e4ee4d None admin] PATH_INFO: `/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:57.516407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292c03a-5369-4723-9187-573ca9e4ee4d None admin] RBAC: Authorizing `identity:get_project(project_id=7dc88f86a18d4432bbe5d3f77e51d91a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:57.517876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292c03a-5369-4723-9187-573ca9e4ee4d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:57.524534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 526/1058] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:29:57 2022] GET /identity/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:29:57.525747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ffff-40c6-4084-8040-c63e526de6df None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:57.620787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ffff-40c6-4084-8040-c63e526de6df None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:57.655205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6715b6-e052-49f7-9fe6-dfdc2514e94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:57.655854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6715b6-e052-49f7-9fe6-dfdc2514e94d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:57.656132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6715b6-e052-49f7-9fe6-dfdc2514e94d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:57.656404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6715b6-e052-49f7-9fe6-dfdc2514e94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:57.657291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6715b6-e052-49f7-9fe6-dfdc2514e94d None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=7dc88f86a18d4432bbe5d3f77e51d91a, user.id=f3090e6b638b4f399d7ae308ef632d42) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:57.657527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6715b6-e052-49f7-9fe6-dfdc2514e94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:57.659042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6715b6-e052-49f7-9fe6-dfdc2514e94d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:57.670106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 533/1059] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:29:57 2022] GET /identity/v3/role_assignments?user.id=f3090e6b638b4f399d7ae308ef632d42&scope.project.id=7dc88f86a18d4432bbe5d3f77e51d91a&role.id=cb77715547a14bae950f68513af00d30 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:58.529639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf758ab-e555-40b4-a901-dd0eb8180189 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:58.530196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf758ab-e555-40b4-a901-dd0eb8180189 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:58.530196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf758ab-e555-40b4-a901-dd0eb8180189 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:58.531537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 527/1060] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:29:58.536836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28775b2-f770-417c-b3de-3ee7a92810eb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:58.537213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28775b2-f770-417c-b3de-3ee7a92810eb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:58.537401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28775b2-f770-417c-b3de-3ee7a92810eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:58.554100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b28775b2-f770-417c-b3de-3ee7a92810eb None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:58.555275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b28775b2-f770-417c-b3de-3ee7a92810eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:58.618851 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 534/1061] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:29:58.640874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf758ab-e555-40b4-a901-dd0eb8180189 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:58.740423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf758ab-e555-40b4-a901-dd0eb8180189 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:58.775928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6911220-57e9-447b-bd59-0c9a801e9273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:58.776597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6911220-57e9-447b-bd59-0c9a801e9273 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:58.776880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6911220-57e9-447b-bd59-0c9a801e9273 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:58.777157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6911220-57e9-447b-bd59-0c9a801e9273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:58.841877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6911220-57e9-447b-bd59-0c9a801e9273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:58.843264 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6911220-57e9-447b-bd59-0c9a801e9273 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:58.909978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abc600-5564-440d-9a2e-e4a9a039e997 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:58.910355 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abc600-5564-440d-9a2e-e4a9a039e997 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:58.910584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abc600-5564-440d-9a2e-e4a9a039e997 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:58.912097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 535/1062] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:58.917144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8a435-496b-4d53-ba05-c893a7f9bbf6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:58.917368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8a435-496b-4d53-ba05-c893a7f9bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:58.917631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8a435-496b-4d53-ba05-c893a7f9bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:58.934829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e1f8a435-496b-4d53-ba05-c893a7f9bbf6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:58.942038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 528/1063] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:29:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:29:58.942251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e1f8a435-496b-4d53-ba05-c893a7f9bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:58.945698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6911220-57e9-447b-bd59-0c9a801e9273 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:59.005027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 536/1064] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:29:59.027245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8a435-496b-4d53-ba05-c893a7f9bbf6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:59.042564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6911220-57e9-447b-bd59-0c9a801e9273 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:59.076405 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9083747-32bc-4ca1-8175-1daf5206d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:59.077181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9083747-32bc-4ca1-8175-1daf5206d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.077457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9083747-32bc-4ca1-8175-1daf5206d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.077724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9083747-32bc-4ca1-8175-1daf5206d2d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.087339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9083747-32bc-4ca1-8175-1daf5206d2d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:59.088787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9083747-32bc-4ca1-8175-1daf5206d2d7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a9083747-32bc-4ca1-8175-1daf5206d2d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:59.106585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:59.107492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:59.108394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:59.108394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:59.108394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:59.108394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:59.112773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 529/1065] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:59.113650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9083747-32bc-4ca1-8175-1daf5206d2d7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:59.120593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8a435-496b-4d53-ba05-c893a7f9bbf6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:59.157025 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30613d-19f0-415a-959a-8950d4c2e44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:59.157832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30613d-19f0-415a-959a-8950d4c2e44e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.158152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30613d-19f0-415a-959a-8950d4c2e44e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.158428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30613d-19f0-415a-959a-8950d4c2e44e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.168578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30613d-19f0-415a-959a-8950d4c2e44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5b30613d-19f0-415a-959a-8950d4c2e44e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:29:59.176569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:59.177578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:29:59.183343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 537/1066] 10.222.0.75 () {56 vars in 1120 bytes} [Tue May 17 15:29:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:29:59.186142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30613d-19f0-415a-959a-8950d4c2e44e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:59.211952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9083747-32bc-4ca1-8175-1daf5206d2d7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:59.248693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565e162-d5a1-4410-945d-0a9fba104efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:59.249343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565e162-d5a1-4410-945d-0a9fba104efb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.249623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565e162-d5a1-4410-945d-0a9fba104efb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.249891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565e162-d5a1-4410-945d-0a9fba104efb None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.250718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565e162-d5a1-4410-945d-0a9fba104efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:59.251022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565e162-d5a1-4410-945d-0a9fba104efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:59.252377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565e162-d5a1-4410-945d-0a9fba104efb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:59.263997 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 530/1067] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:59.292457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30613d-19f0-415a-959a-8950d4c2e44e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:59.328250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c205600-b642-4658-96ad-dbbfeed5c2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:59.328944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c205600-b642-4658-96ad-dbbfeed5c2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.329225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c205600-b642-4658-96ad-dbbfeed5c2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.329498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c205600-b642-4658-96ad-dbbfeed5c2e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.330306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c205600-b642-4658-96ad-dbbfeed5c2e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:59.330622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c205600-b642-4658-96ad-dbbfeed5c2e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:59.332042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c205600-b642-4658-96ad-dbbfeed5c2e2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:59.341072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 538/1068] 10.222.0.75 () {56 vars in 1115 bytes} [Tue May 17 15:29:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:59.349433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565e162-d5a1-4410-945d-0a9fba104efb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:59.451213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565e162-d5a1-4410-945d-0a9fba104efb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:59.484912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda2c7a-f685-472f-8655-49da0c6487dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:59.485706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda2c7a-f685-472f-8655-49da0c6487dd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.485985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda2c7a-f685-472f-8655-49da0c6487dd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.486411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda2c7a-f685-472f-8655-49da0c6487dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.498162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda2c7a-f685-472f-8655-49da0c6487dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:59.499619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda2c7a-f685-472f-8655-49da0c6487dd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8fda2c7a-f685-472f-8655-49da0c6487dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:29:59.516700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:59.517635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:59.518564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:29:59.518564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:29:59.518564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:29:59.518564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:59.522112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 531/1069] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:59.523951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c205600-b642-4658-96ad-dbbfeed5c2e2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:59.623448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c205600-b642-4658-96ad-dbbfeed5c2e2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:59.654460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038876b-1918-4e9b-a835-4df6d7dab33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:59.655120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038876b-1918-4e9b-a835-4df6d7dab33f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.655400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038876b-1918-4e9b-a835-4df6d7dab33f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.655673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038876b-1918-4e9b-a835-4df6d7dab33f None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.656390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038876b-1918-4e9b-a835-4df6d7dab33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:59.656694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038876b-1918-4e9b-a835-4df6d7dab33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:59.658086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038876b-1918-4e9b-a835-4df6d7dab33f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:59.669896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 539/1070] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:59.675463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda2c7a-f685-472f-8655-49da0c6487dd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:59.772723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda2c7a-f685-472f-8655-49da0c6487dd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:59.804586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b257e-21a9-4db5-8f85-f382b6aed9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:59.805362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b257e-21a9-4db5-8f85-f382b6aed9ac None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.805642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b257e-21a9-4db5-8f85-f382b6aed9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.805916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b257e-21a9-4db5-8f85-f382b6aed9ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.813135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b257e-21a9-4db5-8f85-f382b6aed9ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:59.814590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b257e-21a9-4db5-8f85-f382b6aed9ac None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-540b257e-21a9-4db5-8f85-f382b6aed9ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:29:59.827977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:29:59.829072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:29:59.830096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 532/1071] 10.222.0.75 () {56 vars in 1093 bytes} [Tue May 17 15:29:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:29:59.834869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038876b-1918-4e9b-a835-4df6d7dab33f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:59.904405 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98a91d-cf45-4a3e-891e-9b8ed66e0501 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.904686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98a91d-cf45-4a3e-891e-9b8ed66e0501 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.904959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98a91d-cf45-4a3e-891e-9b8ed66e0501 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.906498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 533/1072] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:29:59.911289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c883b8e-3119-4912-9d95-73b363da0ce2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.911578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c883b8e-3119-4912-9d95-73b363da0ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.911862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c883b8e-3119-4912-9d95-73b363da0ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.927849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3c883b8e-3119-4912-9d95-73b363da0ce2 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:29:59.929026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c883b8e-3119-4912-9d95-73b363da0ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:29:59.929589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038876b-1918-4e9b-a835-4df6d7dab33f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:29:59.962346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33016-e618-4c9b-b6d3-b7eda33e1402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:29:59.963008 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33016-e618-4c9b-b6d3-b7eda33e1402 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:29:59.963286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33016-e618-4c9b-b6d3-b7eda33e1402 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:29:59.963560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33016-e618-4c9b-b6d3-b7eda33e1402 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:29:59.964384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc33016-e618-4c9b-b6d3-b7eda33e1402 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:29:59.964689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc33016-e618-4c9b-b6d3-b7eda33e1402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:29:59.966162 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc33016-e618-4c9b-b6d3-b7eda33e1402 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:29:59.982752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 540/1073] 10.222.0.75 () {56 vars in 1133 bytes} [Tue May 17 15:29:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:29:59.988378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33016-e618-4c9b-b6d3-b7eda33e1402 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:29:59.991568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 534/1074] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:29:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:30:00.014682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c883b8e-3119-4912-9d95-73b363da0ce2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:00.079325 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33016-e618-4c9b-b6d3-b7eda33e1402 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.104324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c883b8e-3119-4912-9d95-73b363da0ce2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.110593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6028c-0912-4b12-8636-9903ab97b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.111420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6028c-0912-4b12-8636-9903ab97b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.111702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6028c-0912-4b12-8636-9903ab97b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.111972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6028c-0912-4b12-8636-9903ab97b6a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.121361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6028c-0912-4b12-8636-9903ab97b6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:00.122850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6028c-0912-4b12-8636-9903ab97b6a7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:00.136587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa59f16-f678-4a80-af1f-e9e505370e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.137905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa59f16-f678-4a80-af1f-e9e505370e40 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.138215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa59f16-f678-4a80-af1f-e9e505370e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.138485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa59f16-f678-4a80-af1f-e9e505370e40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3fd6028c-0912-4b12-8636-9903ab97b6a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:30:00.139809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:00.140833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:00.141807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:30:00.141807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:30:00.141807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:30:00.141807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:00.141807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 541/1075] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:30:00.146571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6028c-0912-4b12-8636-9903ab97b6a7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:00.150369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa59f16-f678-4a80-af1f-e9e505370e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-0fa59f16-f678-4a80-af1f-e9e505370e40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:30:00.158601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:00.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:30:00.160438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 535/1076] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:30:00.165657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa59f16-f678-4a80-af1f-e9e505370e40 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:00.239588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6028c-0912-4b12-8636-9903ab97b6a7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.257517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa59f16-f678-4a80-af1f-e9e505370e40 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.272428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba941c0-1c8f-4429-b634-581c95e5512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.273088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba941c0-1c8f-4429-b634-581c95e5512f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.273367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba941c0-1c8f-4429-b634-581c95e5512f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.273640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba941c0-1c8f-4429-b634-581c95e5512f None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.274386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba941c0-1c8f-4429-b634-581c95e5512f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:00.274691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba941c0-1c8f-4429-b634-581c95e5512f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:00.276046 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba941c0-1c8f-4429-b634-581c95e5512f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:00.287270 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 542/1077] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:00.292983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba941c0-1c8f-4429-b634-581c95e5512f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:00.300196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd504e0a-0773-4e81-ae67-ccf634df0b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.300966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504e0a-0773-4e81-ae67-ccf634df0b2b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.301238 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504e0a-0773-4e81-ae67-ccf634df0b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.301498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504e0a-0773-4e81-ae67-ccf634df0b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.302255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd504e0a-0773-4e81-ae67-ccf634df0b2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:00.302553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd504e0a-0773-4e81-ae67-ccf634df0b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:00.303965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd504e0a-0773-4e81-ae67-ccf634df0b2b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:00.314187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 536/1078] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:30:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:00.320249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd504e0a-0773-4e81-ae67-ccf634df0b2b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:00.388668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba941c0-1c8f-4429-b634-581c95e5512f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.414629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd504e0a-0773-4e81-ae67-ccf634df0b2b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.420594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d233719-6c77-4855-8030-edecda53b260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.421381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d233719-6c77-4855-8030-edecda53b260 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.421663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d233719-6c77-4855-8030-edecda53b260 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.421935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d233719-6c77-4855-8030-edecda53b260 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.428344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d233719-6c77-4855-8030-edecda53b260 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:00.429781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d233719-6c77-4855-8030-edecda53b260 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5d233719-6c77-4855-8030-edecda53b260 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:30:00.444921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:00.446027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:00.447125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:30:00.447125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:30:00.447125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:30:00.447125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:30:00.447125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:30:00.447125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:30:00.447125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:30:00.447125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:00.447125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 543/1079] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:30:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:30:00.448401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3f565-6a80-4b3d-bb46-dd95b87d3c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.449312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3f565-6a80-4b3d-bb46-dd95b87d3c65 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.449653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3f565-6a80-4b3d-bb46-dd95b87d3c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.450071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3f565-6a80-4b3d-bb46-dd95b87d3c65 None admin] PATH_INFO: `/v3/users/f3090e6b638b4f399d7ae308ef632d42` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.451798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3f565-6a80-4b3d-bb46-dd95b87d3c65 None admin] RBAC: Authorizing `identity:get_user(user_id=f3090e6b638b4f399d7ae308ef632d42)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:00.452381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d233719-6c77-4855-8030-edecda53b260 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:00.453193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3f565-6a80-4b3d-bb46-dd95b87d3c65 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:00.454947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 537/1080] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:00 2022] GET /identity/v3/users/f3090e6b638b4f399d7ae308ef632d42 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:00.460261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3f565-6a80-4b3d-bb46-dd95b87d3c65 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:00.545561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d233719-6c77-4855-8030-edecda53b260 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.553054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3f565-6a80-4b3d-bb46-dd95b87d3c65 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.577342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6595b-17c1-4a70-ab22-a0a44c438278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.578011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6595b-17c1-4a70-ab22-a0a44c438278 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.578297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6595b-17c1-4a70-ab22-a0a44c438278 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.578572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6595b-17c1-4a70-ab22-a0a44c438278 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.579343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6595b-17c1-4a70-ab22-a0a44c438278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:00.579649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6595b-17c1-4a70-ab22-a0a44c438278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:00.581085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6595b-17c1-4a70-ab22-a0a44c438278 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:00.584194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506ad3c-494d-47c4-bf1d-f17f0ea35141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.585026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506ad3c-494d-47c4-bf1d-f17f0ea35141 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.585301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506ad3c-494d-47c4-bf1d-f17f0ea35141 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.585569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506ad3c-494d-47c4-bf1d-f17f0ea35141 None admin] PATH_INFO: `/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.586744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506ad3c-494d-47c4-bf1d-f17f0ea35141 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc88f86a18d4432bbe5d3f77e51d91a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:00.588177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506ad3c-494d-47c4-bf1d-f17f0ea35141 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:00.589883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 538/1081] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:00 2022] GET /identity/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:00.596451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 544/1082] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:30:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:00.596670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506ad3c-494d-47c4-bf1d-f17f0ea35141 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:00.602164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6595b-17c1-4a70-ab22-a0a44c438278 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:00.696980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6595b-17c1-4a70-ab22-a0a44c438278 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.697632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506ad3c-494d-47c4-bf1d-f17f0ea35141 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:00.728369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c920-6d27-4b30-8255-9dd1470dd382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.729240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c920-6d27-4b30-8255-9dd1470dd382 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.729369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69da27-dcdc-4bf0-8901-53f7da75e599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:00.729518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c920-6d27-4b30-8255-9dd1470dd382 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.729788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c920-6d27-4b30-8255-9dd1470dd382 None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8ef90c1c9c784d8792b3afe6e8e7fb31/roles/90070bf28cac41abaa6ce1d3935dfad3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.730243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69da27-dcdc-4bf0-8901-53f7da75e599 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:00.730531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69da27-dcdc-4bf0-8901-53f7da75e599 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:00.730805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69da27-dcdc-4bf0-8901-53f7da75e599 None admin] PATH_INFO: `/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a/users/f3090e6b638b4f399d7ae308ef632d42/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:00.732814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c920-6d27-4b30-8255-9dd1470dd382 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=8ef90c1c9c784d8792b3afe6e8e7fb31, role_id=90070bf28cac41abaa6ce1d3935dfad3)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:00.733341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69da27-dcdc-4bf0-8901-53f7da75e599 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc88f86a18d4432bbe5d3f77e51d91a, user_id=f3090e6b638b4f399d7ae308ef632d42, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:00.734382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c920-6d27-4b30-8255-9dd1470dd382 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:00.734786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69da27-dcdc-4bf0-8901-53f7da75e599 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:00.747587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 545/1083] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:30:00 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8ef90c1c9c784d8792b3afe6e8e7fb31/roles/90070bf28cac41abaa6ce1d3935dfad3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:30:00.750183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 539/1084] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:30:00 2022] PUT /identity/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a/users/f3090e6b638b4f399d7ae308ef632d42/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:30:02.985358 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc36b60-5444-4137-9370-de31e3c56597 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:02.986021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc36b60-5444-4137-9370-de31e3c56597 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:02.986021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc36b60-5444-4137-9370-de31e3c56597 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:02.986951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760c21f-2a0c-4c11-8eb2-9cbd579da021 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:02.987324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760c21f-2a0c-4c11-8eb2-9cbd579da021 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:02.987406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 546/1085] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:02.987491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760c21f-2a0c-4c11-8eb2-9cbd579da021 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:02.988864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 540/1086] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:30:02.992024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b2323-d644-4f3d-8fbe-52e49da16348 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:02.992308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b2323-d644-4f3d-8fbe-52e49da16348 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:02.992589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b2323-d644-4f3d-8fbe-52e49da16348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:02.993883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a90de-0e2e-4490-bd7c-28a75e7ebf19 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:02.994195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a90de-0e2e-4490-bd7c-28a75e7ebf19 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:02.994470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a90de-0e2e-4490-bd7c-28a75e7ebf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.009352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-217b2323-d644-4f3d-8fbe-52e49da16348 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:03.010577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-217b2323-d644-4f3d-8fbe-52e49da16348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:03.010705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4b1a90de-0e2e-4490-bd7c-28a75e7ebf19 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:03.011718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4b1a90de-0e2e-4490-bd7c-28a75e7ebf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:03.073568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 547/1087] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:03.074107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 541/1088] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 15:30:03.096564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a90de-0e2e-4490-bd7c-28a75e7ebf19 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.096712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b2323-d644-4f3d-8fbe-52e49da16348 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.188523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b2323-d644-4f3d-8fbe-52e49da16348 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.191456 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a90de-0e2e-4490-bd7c-28a75e7ebf19 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.219594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bac26-a73f-49a2-b244-adbe0de1b067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.220402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bac26-a73f-49a2-b244-adbe0de1b067 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.220936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bac26-a73f-49a2-b244-adbe0de1b067 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.221208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bac26-a73f-49a2-b244-adbe0de1b067 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.223524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015af9b6-8979-4cbc-9584-c00693f3248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.224307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015af9b6-8979-4cbc-9584-c00693f3248c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.224589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015af9b6-8979-4cbc-9584-c00693f3248c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.224857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015af9b6-8979-4cbc-9584-c00693f3248c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.232038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bac26-a73f-49a2-b244-adbe0de1b067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:30:03.235135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015af9b6-8979-4cbc-9584-c00693f3248c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-347bac26-a73f-49a2-b244-adbe0de1b067 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:30:03.240181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:03.241442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:03.242426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 548/1089] 10.222.0.75 () {56 vars in 1120 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-015af9b6-8979-4cbc-9584-c00693f3248c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:30:03.244059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:03.245132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:03.246628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:30:03.248018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bac26-a73f-49a2-b244-adbe0de1b067 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.250066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 542/1090] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:03.255093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015af9b6-8979-4cbc-9584-c00693f3248c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.339421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bac26-a73f-49a2-b244-adbe0de1b067 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.346822 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015af9b6-8979-4cbc-9584-c00693f3248c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.370662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab8a68-6a69-43a1-9d35-f6ac2f72692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.371316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab8a68-6a69-43a1-9d35-f6ac2f72692c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.372141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab8a68-6a69-43a1-9d35-f6ac2f72692c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.372425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab8a68-6a69-43a1-9d35-f6ac2f72692c None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.373165 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab8a68-6a69-43a1-9d35-f6ac2f72692c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:03.373468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab8a68-6a69-43a1-9d35-f6ac2f72692c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:03.374859 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab8a68-6a69-43a1-9d35-f6ac2f72692c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:03.378974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f78f-8b2b-4eb2-a14f-f1d9d81c871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.379633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f78f-8b2b-4eb2-a14f-f1d9d81c871f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.379913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f78f-8b2b-4eb2-a14f-f1d9d81c871f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.380182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f78f-8b2b-4eb2-a14f-f1d9d81c871f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.380916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92f78f-8b2b-4eb2-a14f-f1d9d81c871f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:03.381220 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92f78f-8b2b-4eb2-a14f-f1d9d81c871f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:03.382575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 549/1091] 10.222.0.75 () {56 vars in 1115 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:03.387232 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92f78f-8b2b-4eb2-a14f-f1d9d81c871f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:03.388279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab8a68-6a69-43a1-9d35-f6ac2f72692c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.390679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 543/1092] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:03.397438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f78f-8b2b-4eb2-a14f-f1d9d81c871f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.485244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab8a68-6a69-43a1-9d35-f6ac2f72692c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.491428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f78f-8b2b-4eb2-a14f-f1d9d81c871f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.515958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a57ff-718c-4741-ad10-38aec9338532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.516736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a57ff-718c-4741-ad10-38aec9338532 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.517014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a57ff-718c-4741-ad10-38aec9338532 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.517287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a57ff-718c-4741-ad10-38aec9338532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.522291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76efda-25e7-4d6b-a9f9-98c6f45ebeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.523139 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76efda-25e7-4d6b-a9f9-98c6f45ebeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.523422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76efda-25e7-4d6b-a9f9-98c6f45ebeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.523689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76efda-25e7-4d6b-a9f9-98c6f45ebeb9 None admin] PATH_INFO: `/v3/users/f3090e6b638b4f399d7ae308ef632d42` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.524863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76efda-25e7-4d6b-a9f9-98c6f45ebeb9 None admin] RBAC: Authorizing `identity:get_user(user_id=f3090e6b638b4f399d7ae308ef632d42)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:03.526300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76efda-25e7-4d6b-a9f9-98c6f45ebeb9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:03.527352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a57ff-718c-4741-ad10-38aec9338532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:03.528408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 544/1093] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/users/f3090e6b638b4f399d7ae308ef632d42 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:03.533303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a57ff-718c-4741-ad10-38aec9338532 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:03.533914 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76efda-25e7-4d6b-a9f9-98c6f45ebeb9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-375a57ff-718c-4741-ad10-38aec9338532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:30:03.546632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:03.547748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:03.548649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:30:03.548649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:30:03.548649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:30:03.548649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:03.552490 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 550/1094] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:30:03.553327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a57ff-718c-4741-ad10-38aec9338532 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.631378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76efda-25e7-4d6b-a9f9-98c6f45ebeb9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.649407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a57ff-718c-4741-ad10-38aec9338532 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.663090 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0804-7a31-46bf-9fe3-a9f01fcf5584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.663730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0804-7a31-46bf-9fe3-a9f01fcf5584 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.664010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0804-7a31-46bf-9fe3-a9f01fcf5584 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.664285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0804-7a31-46bf-9fe3-a9f01fcf5584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.681334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a05a00-23a9-485c-b471-296b389939e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.681978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a05a00-23a9-485c-b471-296b389939e8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.682284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a05a00-23a9-485c-b471-296b389939e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.682557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a05a00-23a9-485c-b471-296b389939e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.683264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a05a00-23a9-485c-b471-296b389939e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:03.683567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a05a00-23a9-485c-b471-296b389939e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:03.685029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a05a00-23a9-485c-b471-296b389939e8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:03.696119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 551/1095] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:03.702209 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a05a00-23a9-485c-b471-296b389939e8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.733442 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d0804-7a31-46bf-9fe3-a9f01fcf5584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:03.734911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d0804-7a31-46bf-9fe3-a9f01fcf5584 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:03.803101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a05a00-23a9-485c-b471-296b389939e8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.826802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 545/1096] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 15:30:03.832525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0804-7a31-46bf-9fe3-a9f01fcf5584 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.834597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaac6fc-8a0b-43c4-88f8-67a3d6d4de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.835378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaac6fc-8a0b-43c4-88f8-67a3d6d4de76 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.835656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaac6fc-8a0b-43c4-88f8-67a3d6d4de76 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.835927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaac6fc-8a0b-43c4-88f8-67a3d6d4de76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.843388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaac6fc-8a0b-43c4-88f8-67a3d6d4de76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:03.844807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaac6fc-8a0b-43c4-88f8-67a3d6d4de76 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7aaac6fc-8a0b-43c4-88f8-67a3d6d4de76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:30:03.861517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:03.862716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:03.863925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 552/1097] 10.222.0.75 () {56 vars in 1093 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:30:03.870023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaac6fc-8a0b-43c4-88f8-67a3d6d4de76 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:03.952029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0804-7a31-46bf-9fe3-a9f01fcf5584 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.981650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaac6fc-8a0b-43c4-88f8-67a3d6d4de76 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:03.988148 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ff57-3ee3-45fd-8072-a47895f18ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:03.989510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ff57-3ee3-45fd-8072-a47895f18ecc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:03.989791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ff57-3ee3-45fd-8072-a47895f18ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:03.990153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ff57-3ee3-45fd-8072-a47895f18ecc None admin] PATH_INFO: `/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:03.991366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265ff57-3ee3-45fd-8072-a47895f18ecc None admin] RBAC: Authorizing `identity:get_project(project_id=7dc88f86a18d4432bbe5d3f77e51d91a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:03.992797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265ff57-3ee3-45fd-8072-a47895f18ecc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:03.994705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 546/1098] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:04.000897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ff57-3ee3-45fd-8072-a47895f18ecc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:04.021013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197b15c-6f0f-417b-888c-cbeb51550146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:04.022500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197b15c-6f0f-417b-888c-cbeb51550146 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:04.022797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197b15c-6f0f-417b-888c-cbeb51550146 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:04.023104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197b15c-6f0f-417b-888c-cbeb51550146 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:04.024317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197b15c-6f0f-417b-888c-cbeb51550146 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:04.024317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197b15c-6f0f-417b-888c-cbeb51550146 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:04.025724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197b15c-6f0f-417b-888c-cbeb51550146 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:04.045056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 553/1099] 10.222.0.75 () {56 vars in 1133 bytes} [Tue May 17 15:30:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:04.051321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197b15c-6f0f-417b-888c-cbeb51550146 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:04.109674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ff57-3ee3-45fd-8072-a47895f18ecc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:04.147505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d71233-8a3a-46f3-abe4-53eb5c22472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:04.148073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71233-8a3a-46f3-abe4-53eb5c22472f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:04.148349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71233-8a3a-46f3-abe4-53eb5c22472f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:04.148617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71233-8a3a-46f3-abe4-53eb5c22472f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:04.149440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d71233-8a3a-46f3-abe4-53eb5c22472f None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=7dc88f86a18d4432bbe5d3f77e51d91a, user.id=f3090e6b638b4f399d7ae308ef632d42) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:04.149744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d71233-8a3a-46f3-abe4-53eb5c22472f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:04.151208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d71233-8a3a-46f3-abe4-53eb5c22472f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:04.157831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 547/1100] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:30:04 2022] GET /identity/v3/role_assignments?user.id=f3090e6b638b4f399d7ae308ef632d42&scope.project.id=7dc88f86a18d4432bbe5d3f77e51d91a&role.id=cb77715547a14bae950f68513af00d30 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:04.158751 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197b15c-6f0f-417b-888c-cbeb51550146 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:04.196862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73362d-316c-4f34-adc9-29ba78f905fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:04.197547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73362d-316c-4f34-adc9-29ba78f905fe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:04.197808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73362d-316c-4f34-adc9-29ba78f905fe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:04.198140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73362d-316c-4f34-adc9-29ba78f905fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:04.267967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73362d-316c-4f34-adc9-29ba78f905fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:04.269443 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73362d-316c-4f34-adc9-29ba78f905fe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:04.366580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 554/1101] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:30:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 15:30:04.372625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d71233-8a3a-46f3-abe4-53eb5c22472f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:04.471385 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d71233-8a3a-46f3-abe4-53eb5c22472f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:04.502981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d884b4b-32e1-4a04-904e-247f29cfadf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:04.503759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884b4b-32e1-4a04-904e-247f29cfadf2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:04.504040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884b4b-32e1-4a04-904e-247f29cfadf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:04.504310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884b4b-32e1-4a04-904e-247f29cfadf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:04.514278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d884b4b-32e1-4a04-904e-247f29cfadf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:04.515698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d884b4b-32e1-4a04-904e-247f29cfadf2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3d884b4b-32e1-4a04-904e-247f29cfadf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:30:04.532477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:04.533485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:04.534444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:30:04.534444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:30:04.534444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:30:04.534444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:30:04.534444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 548/1102] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:04.539268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73362d-316c-4f34-adc9-29ba78f905fe None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:04.633384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73362d-316c-4f34-adc9-29ba78f905fe None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:04.664498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22e74-ff03-4106-b2a4-3f67eca967a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:04.665156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22e74-ff03-4106-b2a4-3f67eca967a7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:04.665441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22e74-ff03-4106-b2a4-3f67eca967a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:04.665719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22e74-ff03-4106-b2a4-3f67eca967a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:04.666470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22e74-ff03-4106-b2a4-3f67eca967a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:04.666777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22e74-ff03-4106-b2a4-3f67eca967a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:04.668144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22e74-ff03-4106-b2a4-3f67eca967a7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:04.679499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 555/1103] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:04.685534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d884b4b-32e1-4a04-904e-247f29cfadf2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:04.779353 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d884b4b-32e1-4a04-904e-247f29cfadf2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:04.811681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f442-09cb-4dd7-9b1b-0ab56d328cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:04.812452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f442-09cb-4dd7-9b1b-0ab56d328cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:04.812736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f442-09cb-4dd7-9b1b-0ab56d328cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:04.813012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f442-09cb-4dd7-9b1b-0ab56d328cc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:04.819374 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032f442-09cb-4dd7-9b1b-0ab56d328cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:04.820797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032f442-09cb-4dd7-9b1b-0ab56d328cc4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8032f442-09cb-4dd7-9b1b-0ab56d328cc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:30:04.834025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:04.834946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:04.835861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:30:04.835861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:30:04.835861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:30:04.835861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:30:04.835861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:30:04.835861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:30:04.835861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:30:04.835861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:30:04.835861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 549/1104] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:04.840939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22e74-ff03-4106-b2a4-3f67eca967a7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:04.937383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22e74-ff03-4106-b2a4-3f67eca967a7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:04.968996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefabac-56d2-42da-bde1-4e18050bdf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:04.969653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefabac-56d2-42da-bde1-4e18050bdf90 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:04.969935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefabac-56d2-42da-bde1-4e18050bdf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:04.970239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefabac-56d2-42da-bde1-4e18050bdf90 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:04.971281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefabac-56d2-42da-bde1-4e18050bdf90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:04.971588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefabac-56d2-42da-bde1-4e18050bdf90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:04.973009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefabac-56d2-42da-bde1-4e18050bdf90 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:04.984518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 556/1105] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:04.990475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f442-09cb-4dd7-9b1b-0ab56d328cc4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:05.083805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f442-09cb-4dd7-9b1b-0ab56d328cc4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:05.114268 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffa4e7-78df-4b55-9b63-decafe948913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:05.114898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffa4e7-78df-4b55-9b63-decafe948913 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:05.115173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffa4e7-78df-4b55-9b63-decafe948913 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:05.115442 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffa4e7-78df-4b55-9b63-decafe948913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:05.116255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffa4e7-78df-4b55-9b63-decafe948913 None admin] RBAC: Adding query filter params (role.id=90070bf28cac41abaa6ce1d3935dfad3, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8ef90c1c9c784d8792b3afe6e8e7fb31) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:05.116559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffa4e7-78df-4b55-9b63-decafe948913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:05.117959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffa4e7-78df-4b55-9b63-decafe948913 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:05.123944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 550/1106] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:30:04 2022] GET /identity/v3/role_assignments?user.id=8ef90c1c9c784d8792b3afe6e8e7fb31&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=90070bf28cac41abaa6ce1d3935dfad3 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:06.422117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5af95-cbf4-4b5f-96cc-9af8b10608b5 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:06.422639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5af95-cbf4-4b5f-96cc-9af8b10608b5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:06.422639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5af95-cbf4-4b5f-96cc-9af8b10608b5 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:06.423916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 557/1107] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:06.429117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6356cc2-fa0e-446a-8e10-29cde55fc8df None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:06.429551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6356cc2-fa0e-446a-8e10-29cde55fc8df None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:06.429680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6356cc2-fa0e-446a-8e10-29cde55fc8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:06.446492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d6356cc2-fa0e-446a-8e10-29cde55fc8df None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:06.447679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d6356cc2-fa0e-446a-8e10-29cde55fc8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:06.510159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 551/1108] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:06.535741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5af95-cbf4-4b5f-96cc-9af8b10608b5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:06.633393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5af95-cbf4-4b5f-96cc-9af8b10608b5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:06.665041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645386f1-7f77-42a2-83b9-77e0b1701570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:06.665819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645386f1-7f77-42a2-83b9-77e0b1701570 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:06.666130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645386f1-7f77-42a2-83b9-77e0b1701570 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:06.666406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645386f1-7f77-42a2-83b9-77e0b1701570 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:06.667570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645386f1-7f77-42a2-83b9-77e0b1701570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:06.669020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645386f1-7f77-42a2-83b9-77e0b1701570 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:06.670658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 558/1109] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:30:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:06.676470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6356cc2-fa0e-446a-8e10-29cde55fc8df None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:06.768846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6356cc2-fa0e-446a-8e10-29cde55fc8df None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:06.800826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374e33a-9386-4e6b-b0d9-21d94f8fb514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:06.801475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374e33a-9386-4e6b-b0d9-21d94f8fb514 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:06.801755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374e33a-9386-4e6b-b0d9-21d94f8fb514 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:06.802052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374e33a-9386-4e6b-b0d9-21d94f8fb514 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:06.802748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374e33a-9386-4e6b-b0d9-21d94f8fb514 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:06.804169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374e33a-9386-4e6b-b0d9-21d94f8fb514 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:06.823149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 552/1110] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:30:06 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:30:09.063849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae80a3-f4d6-4c8b-9a54-2b4a545d27c1 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:09.064403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae80a3-f4d6-4c8b-9a54-2b4a545d27c1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:09.064403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae80a3-f4d6-4c8b-9a54-2b4a545d27c1 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:09.065733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 559/1111] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:09.071045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60332d2d-aa16-4d12-84c6-fac716df2611 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:09.071465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60332d2d-aa16-4d12-84c6-fac716df2611 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:09.071604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60332d2d-aa16-4d12-84c6-fac716df2611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:09.088250 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-60332d2d-aa16-4d12-84c6-fac716df2611 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:09.089432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-60332d2d-aa16-4d12-84c6-fac716df2611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:09.151633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 553/1112] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:09.174848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae80a3-f4d6-4c8b-9a54-2b4a545d27c1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:09.273008 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae80a3-f4d6-4c8b-9a54-2b4a545d27c1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:09.307121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef16880-dc41-4752-851e-aead8a2eb485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:09.307975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef16880-dc41-4752-851e-aead8a2eb485 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:09.308252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef16880-dc41-4752-851e-aead8a2eb485 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:09.308525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef16880-dc41-4752-851e-aead8a2eb485 None admin] PATH_INFO: `/v3/roles/552d2ed1429f43ac91cee158ee03be96` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:09.310053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef16880-dc41-4752-851e-aead8a2eb485 None admin] RBAC: Authorizing `identity:get_role(role_id=552d2ed1429f43ac91cee158ee03be96)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:09.311427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef16880-dc41-4752-851e-aead8a2eb485 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:09.312800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 560/1113] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:09 2022] GET /identity/v3/roles/552d2ed1429f43ac91cee158ee03be96 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:09.318732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60332d2d-aa16-4d12-84c6-fac716df2611 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:09.416652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60332d2d-aa16-4d12-84c6-fac716df2611 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:09.448299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d15f5d-034a-41ef-b4ec-cdc34ba049ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:09.449156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d15f5d-034a-41ef-b4ec-cdc34ba049ba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:09.449643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d15f5d-034a-41ef-b4ec-cdc34ba049ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:09.450555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d15f5d-034a-41ef-b4ec-cdc34ba049ba None admin] PATH_INFO: `/v3/users/620aab5aa67241e7850f68cfba7037b1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:09.464868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d15f5d-034a-41ef-b4ec-cdc34ba049ba None admin] RBAC: Authorizing `identity:get_user(user_id=620aab5aa67241e7850f68cfba7037b1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:09.466587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d15f5d-034a-41ef-b4ec-cdc34ba049ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:09.468247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 554/1114] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:09 2022] GET /identity/v3/users/620aab5aa67241e7850f68cfba7037b1 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:09.474262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef16880-dc41-4752-851e-aead8a2eb485 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:09.566085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef16880-dc41-4752-851e-aead8a2eb485 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:09.597815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e1089-a1b0-4ff3-8722-e6e6b03b4cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:09.598435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1089-a1b0-4ff3-8722-e6e6b03b4cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:09.598719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1089-a1b0-4ff3-8722-e6e6b03b4cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:09.598994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1089-a1b0-4ff3-8722-e6e6b03b4cb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:09.668978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e1089-a1b0-4ff3-8722-e6e6b03b4cb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:09.670490 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e1089-a1b0-4ff3-8722-e6e6b03b4cb4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:09.765333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 561/1115] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:30:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:30:09.771214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d15f5d-034a-41ef-b4ec-cdc34ba049ba None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:09.864897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d15f5d-034a-41ef-b4ec-cdc34ba049ba None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:09.896208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476f0e-ccac-4a49-99a6-56ccbcc0b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:09.897043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476f0e-ccac-4a49-99a6-56ccbcc0b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:09.897317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476f0e-ccac-4a49-99a6-56ccbcc0b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:09.897584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476f0e-ccac-4a49-99a6-56ccbcc0b5a2 None admin] PATH_INFO: `/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:09.898749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64476f0e-ccac-4a49-99a6-56ccbcc0b5a2 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc88f86a18d4432bbe5d3f77e51d91a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:09.900155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64476f0e-ccac-4a49-99a6-56ccbcc0b5a2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:09.901806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 555/1116] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:09 2022] GET /identity/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:09.908615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e1089-a1b0-4ff3-8722-e6e6b03b4cb4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:10.001871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e1089-a1b0-4ff3-8722-e6e6b03b4cb4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:10.033535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0b488-02d7-4bbe-b568-06e268fde8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:10.034197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b488-02d7-4bbe-b568-06e268fde8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:10.034479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b488-02d7-4bbe-b568-06e268fde8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:10.034759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b488-02d7-4bbe-b568-06e268fde8a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:10.035567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0b488-02d7-4bbe-b568-06e268fde8a6 None admin] RBAC: Adding query filter params (role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=7dc88f86a18d4432bbe5d3f77e51d91a, user.id=620aab5aa67241e7850f68cfba7037b1) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:10.035876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0b488-02d7-4bbe-b568-06e268fde8a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:10.037288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0b488-02d7-4bbe-b568-06e268fde8a6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:10.042464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 562/1117] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:30:09 2022] GET /identity/v3/role_assignments?user.id=620aab5aa67241e7850f68cfba7037b1&scope.project.id=7dc88f86a18d4432bbe5d3f77e51d91a&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:12.217522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d12b0-b44e-4a46-a615-43ae8bb4174b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:12.218052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d12b0-b44e-4a46-a615-43ae8bb4174b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:12.218172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d12b0-b44e-4a46-a615-43ae8bb4174b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:12.219465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 556/1118] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:12.224803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c621b-5eb0-481d-81c7-bb235af22e36 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:12.225219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c621b-5eb0-481d-81c7-bb235af22e36 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:12.225340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c621b-5eb0-481d-81c7-bb235af22e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:12.241664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-200c621b-5eb0-481d-81c7-bb235af22e36 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:12.242864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-200c621b-5eb0-481d-81c7-bb235af22e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:12.313280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 563/1119] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:12.335765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d12b0-b44e-4a46-a615-43ae8bb4174b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:12.429920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d12b0-b44e-4a46-a615-43ae8bb4174b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:12.461590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692d976-0ad9-4082-86f1-311c7e197a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:12.462594 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692d976-0ad9-4082-86f1-311c7e197a65 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:12.462875 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692d976-0ad9-4082-86f1-311c7e197a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:12.463147 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692d976-0ad9-4082-86f1-311c7e197a65 None admin] PATH_INFO: `/v3/roles/552d2ed1429f43ac91cee158ee03be96` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:12.464604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692d976-0ad9-4082-86f1-311c7e197a65 None admin] RBAC: Authorizing `identity:get_role(role_id=552d2ed1429f43ac91cee158ee03be96)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:12.465978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692d976-0ad9-4082-86f1-311c7e197a65 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:12.467351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 557/1120] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:12 2022] GET /identity/v3/roles/552d2ed1429f43ac91cee158ee03be96 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:12.473965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c621b-5eb0-481d-81c7-bb235af22e36 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:12.565313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c621b-5eb0-481d-81c7-bb235af22e36 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:12.597469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051ec48-9baa-46f8-bf30-451826c301d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:12.598370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051ec48-9baa-46f8-bf30-451826c301d5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:12.598643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051ec48-9baa-46f8-bf30-451826c301d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:12.598909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051ec48-9baa-46f8-bf30-451826c301d5 None admin] PATH_INFO: `/v3/users/620aab5aa67241e7850f68cfba7037b1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:12.600079 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051ec48-9baa-46f8-bf30-451826c301d5 None admin] RBAC: Authorizing `identity:get_user(user_id=620aab5aa67241e7850f68cfba7037b1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:12.601515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051ec48-9baa-46f8-bf30-451826c301d5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:12.603154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 564/1121] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:12 2022] GET /identity/v3/users/620aab5aa67241e7850f68cfba7037b1 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:12.608879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692d976-0ad9-4082-86f1-311c7e197a65 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:12.701595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692d976-0ad9-4082-86f1-311c7e197a65 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:12.733296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c69cce-de27-4a8f-8ada-6f17a9a4181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:12.734180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c69cce-de27-4a8f-8ada-6f17a9a4181a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:12.734462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c69cce-de27-4a8f-8ada-6f17a9a4181a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:12.734732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c69cce-de27-4a8f-8ada-6f17a9a4181a None admin] PATH_INFO: `/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:12.735891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c69cce-de27-4a8f-8ada-6f17a9a4181a None admin] RBAC: Authorizing `identity:get_project(project_id=7dc88f86a18d4432bbe5d3f77e51d91a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:12.737318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c69cce-de27-4a8f-8ada-6f17a9a4181a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:12.739004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 558/1122] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:12 2022] GET /identity/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:12.744802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051ec48-9baa-46f8-bf30-451826c301d5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:12.838484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051ec48-9baa-46f8-bf30-451826c301d5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:12.873869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563d22c-7363-450e-aae6-095ca35b0f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:12.874803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563d22c-7363-450e-aae6-095ca35b0f61 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:12.875081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563d22c-7363-450e-aae6-095ca35b0f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:12.875348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563d22c-7363-450e-aae6-095ca35b0f61 None admin] PATH_INFO: `/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a/users/620aab5aa67241e7850f68cfba7037b1/roles/552d2ed1429f43ac91cee158ee03be96` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:12.877506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563d22c-7363-450e-aae6-095ca35b0f61 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc88f86a18d4432bbe5d3f77e51d91a, user_id=620aab5aa67241e7850f68cfba7037b1, role_id=552d2ed1429f43ac91cee158ee03be96)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:12.878957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563d22c-7363-450e-aae6-095ca35b0f61 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:12.891086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 565/1123] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:30:12 2022] PUT /identity/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a/users/620aab5aa67241e7850f68cfba7037b1/roles/552d2ed1429f43ac91cee158ee03be96 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:30:15.057925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62648e2e-1f8a-4c32-8e1a-cb033589b511 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:15.058489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62648e2e-1f8a-4c32-8e1a-cb033589b511 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:15.058489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62648e2e-1f8a-4c32-8e1a-cb033589b511 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:15.059854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 559/1124] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:15.065112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd8bdc-7695-4a2f-81b7-601223515b90 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:15.065515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd8bdc-7695-4a2f-81b7-601223515b90 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:15.065652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd8bdc-7695-4a2f-81b7-601223515b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:15.082431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-eccd8bdc-7695-4a2f-81b7-601223515b90 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:15.083610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-eccd8bdc-7695-4a2f-81b7-601223515b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:15.149650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 566/1125] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:15.173287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62648e2e-1f8a-4c32-8e1a-cb033589b511 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:15.271001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62648e2e-1f8a-4c32-8e1a-cb033589b511 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:15.302531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8ac1-66fb-450b-b95f-90f751032493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:15.303356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8ac1-66fb-450b-b95f-90f751032493 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:15.303632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8ac1-66fb-450b-b95f-90f751032493 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:15.303907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8ac1-66fb-450b-b95f-90f751032493 None admin] PATH_INFO: `/v3/roles/552d2ed1429f43ac91cee158ee03be96` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:15.305376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e8ac1-66fb-450b-b95f-90f751032493 None admin] RBAC: Authorizing `identity:get_role(role_id=552d2ed1429f43ac91cee158ee03be96)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:15.306754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e8ac1-66fb-450b-b95f-90f751032493 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:15.308149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 560/1126] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:15 2022] GET /identity/v3/roles/552d2ed1429f43ac91cee158ee03be96 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:15.313878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd8bdc-7695-4a2f-81b7-601223515b90 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:15.406798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd8bdc-7695-4a2f-81b7-601223515b90 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:15.438337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9791117-4b2d-49b3-8839-f26f50192b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:15.439188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9791117-4b2d-49b3-8839-f26f50192b66 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:15.439464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9791117-4b2d-49b3-8839-f26f50192b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:15.439730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9791117-4b2d-49b3-8839-f26f50192b66 None admin] PATH_INFO: `/v3/users/620aab5aa67241e7850f68cfba7037b1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:15.440888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9791117-4b2d-49b3-8839-f26f50192b66 None admin] RBAC: Authorizing `identity:get_user(user_id=620aab5aa67241e7850f68cfba7037b1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:15.442335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9791117-4b2d-49b3-8839-f26f50192b66 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:15.443931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 567/1127] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:15 2022] GET /identity/v3/users/620aab5aa67241e7850f68cfba7037b1 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:15.450112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8ac1-66fb-450b-b95f-90f751032493 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:15.546929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8ac1-66fb-450b-b95f-90f751032493 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:15.578730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dca34-37f0-4cb0-944c-64d8187c87db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:15.579308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dca34-37f0-4cb0-944c-64d8187c87db None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:15.579589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dca34-37f0-4cb0-944c-64d8187c87db None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:15.579863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dca34-37f0-4cb0-944c-64d8187c87db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:15.642235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dca34-37f0-4cb0-944c-64d8187c87db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:15.643662 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dca34-37f0-4cb0-944c-64d8187c87db None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:15.735974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 561/1128] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:30:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:30:15.742618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9791117-4b2d-49b3-8839-f26f50192b66 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:15.837401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9791117-4b2d-49b3-8839-f26f50192b66 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:15.868858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81138ec-5710-4060-97f9-ae86e28de7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:15.869697 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81138ec-5710-4060-97f9-ae86e28de7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:15.869981 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81138ec-5710-4060-97f9-ae86e28de7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:15.870282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81138ec-5710-4060-97f9-ae86e28de7b4 None admin] PATH_INFO: `/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:15.872022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81138ec-5710-4060-97f9-ae86e28de7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc88f86a18d4432bbe5d3f77e51d91a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:15.873509 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81138ec-5710-4060-97f9-ae86e28de7b4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:15.875208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 568/1129] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:15 2022] GET /identity/v3/projects/7dc88f86a18d4432bbe5d3f77e51d91a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:15.881168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dca34-37f0-4cb0-944c-64d8187c87db None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:15.972846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dca34-37f0-4cb0-944c-64d8187c87db None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:16.007888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d99be-7ddc-4dff-9e3f-a1144cb674be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:16.008536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d99be-7ddc-4dff-9e3f-a1144cb674be None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:16.008820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d99be-7ddc-4dff-9e3f-a1144cb674be None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:16.009093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d99be-7ddc-4dff-9e3f-a1144cb674be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:16.009918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d99be-7ddc-4dff-9e3f-a1144cb674be None admin] RBAC: Adding query filter params (role.id=552d2ed1429f43ac91cee158ee03be96, scope.project.id=7dc88f86a18d4432bbe5d3f77e51d91a, user.id=620aab5aa67241e7850f68cfba7037b1) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:16.010259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d99be-7ddc-4dff-9e3f-a1144cb674be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:16.012364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d99be-7ddc-4dff-9e3f-a1144cb674be None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:16.019094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 562/1130] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:30:15 2022] GET /identity/v3/role_assignments?user.id=620aab5aa67241e7850f68cfba7037b1&scope.project.id=7dc88f86a18d4432bbe5d3f77e51d91a&role.id=552d2ed1429f43ac91cee158ee03be96 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:18.264160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cf658-11b8-419d-ad9c-be158405f2b7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:18.264691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cf658-11b8-419d-ad9c-be158405f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:18.264794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cf658-11b8-419d-ad9c-be158405f2b7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:18.266078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 569/1131] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:18.271310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223317f9-4f06-4c64-a18c-37fe1e70e57b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:18.271729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223317f9-4f06-4c64-a18c-37fe1e70e57b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:18.271873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223317f9-4f06-4c64-a18c-37fe1e70e57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:18.288485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-223317f9-4f06-4c64-a18c-37fe1e70e57b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:18.289660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-223317f9-4f06-4c64-a18c-37fe1e70e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:18.352725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 563/1132] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:18.375701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cf658-11b8-419d-ad9c-be158405f2b7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:18.473117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cf658-11b8-419d-ad9c-be158405f2b7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:18.504050 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1033b-bff6-46ad-a511-e6a2503b0285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:18.504816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1033b-bff6-46ad-a511-e6a2503b0285 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:18.505096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1033b-bff6-46ad-a511-e6a2503b0285 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:18.505366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1033b-bff6-46ad-a511-e6a2503b0285 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:18.506526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1033b-bff6-46ad-a511-e6a2503b0285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:18.507936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1033b-bff6-46ad-a511-e6a2503b0285 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:18.509488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 570/1133] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:30:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:18.516089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223317f9-4f06-4c64-a18c-37fe1e70e57b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:18.609052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223317f9-4f06-4c64-a18c-37fe1e70e57b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:18.641891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397720-0a7c-4b68-9348-186d891e585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:18.642562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397720-0a7c-4b68-9348-186d891e585e None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:18.642839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397720-0a7c-4b68-9348-186d891e585e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:18.643106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397720-0a7c-4b68-9348-186d891e585e None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:18.643794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397720-0a7c-4b68-9348-186d891e585e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:18.645201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397720-0a7c-4b68-9348-186d891e585e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:18.668735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 564/1134] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:30:18 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:30:20.906415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e377e-1c31-4d3e-afeb-3eb76cf25ae9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:20.906936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e377e-1c31-4d3e-afeb-3eb76cf25ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:20.906936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e377e-1c31-4d3e-afeb-3eb76cf25ae9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:20.908291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 571/1135] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:20.913543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d897794-246d-4373-840b-f49cb2ee7073 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:20.913942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d897794-246d-4373-840b-f49cb2ee7073 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:20.914161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d897794-246d-4373-840b-f49cb2ee7073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:20.930315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5d897794-246d-4373-840b-f49cb2ee7073 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:20.931491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5d897794-246d-4373-840b-f49cb2ee7073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:20.994424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 565/1136] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:21.019904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e377e-1c31-4d3e-afeb-3eb76cf25ae9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:21.116018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e377e-1c31-4d3e-afeb-3eb76cf25ae9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:21.147878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c5c8-1053-4f1c-8af1-7cbf052c094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:21.148659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c5c8-1053-4f1c-8af1-7cbf052c094b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:21.148942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c5c8-1053-4f1c-8af1-7cbf052c094b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:21.149216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c5c8-1053-4f1c-8af1-7cbf052c094b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:21.150408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c5c8-1053-4f1c-8af1-7cbf052c094b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:21.151840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c5c8-1053-4f1c-8af1-7cbf052c094b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:21.153455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 572/1137] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:30:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:21.159174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d897794-246d-4373-840b-f49cb2ee7073 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:21.255794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d897794-246d-4373-840b-f49cb2ee7073 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:21.290653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94f540-e607-4a62-9baa-c7c846a94841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:21.291419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94f540-e607-4a62-9baa-c7c846a94841 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:21.291707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94f540-e607-4a62-9baa-c7c846a94841 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:21.291979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94f540-e607-4a62-9baa-c7c846a94841 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:21.293220 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94f540-e607-4a62-9baa-c7c846a94841 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:21.294675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94f540-e607-4a62-9baa-c7c846a94841 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:21.314458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 566/1138] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:30:21 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:30:23.556895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9abd-43db-4491-aedb-bf932fdfa3a5 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:23.557388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9abd-43db-4491-aedb-bf932fdfa3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:23.557388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9abd-43db-4491-aedb-bf932fdfa3a5 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:23.559274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 573/1139] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:23.564403 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4775ba-10f4-449b-8dcc-4e08f813dacb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:23.564817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4775ba-10f4-449b-8dcc-4e08f813dacb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:23.564961 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4775ba-10f4-449b-8dcc-4e08f813dacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:23.581085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7d4775ba-10f4-449b-8dcc-4e08f813dacb None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:23.582300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7d4775ba-10f4-449b-8dcc-4e08f813dacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:23.647235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 567/1140] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:23.670712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9abd-43db-4491-aedb-bf932fdfa3a5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:23.764987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9abd-43db-4491-aedb-bf932fdfa3a5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:23.796428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974a02-53e1-4a38-9310-5ae2a74d089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:23.797194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974a02-53e1-4a38-9310-5ae2a74d089e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:23.797469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974a02-53e1-4a38-9310-5ae2a74d089e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:23.797738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974a02-53e1-4a38-9310-5ae2a74d089e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:23.807161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974a02-53e1-4a38-9310-5ae2a74d089e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4b974a02-53e1-4a38-9310-5ae2a74d089e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:30:23.814560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:23.815644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:23.816629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 574/1141] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:23.821651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4775ba-10f4-449b-8dcc-4e08f813dacb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:23.913511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4775ba-10f4-449b-8dcc-4e08f813dacb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:23.945307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de70a9-741d-4ae3-9fd3-2cf49e3010a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:23.945960 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de70a9-741d-4ae3-9fd3-2cf49e3010a0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:23.946271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de70a9-741d-4ae3-9fd3-2cf49e3010a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:23.946548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de70a9-741d-4ae3-9fd3-2cf49e3010a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:23.947293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de70a9-741d-4ae3-9fd3-2cf49e3010a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:23.947598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de70a9-741d-4ae3-9fd3-2cf49e3010a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:23.948986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de70a9-741d-4ae3-9fd3-2cf49e3010a0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:23.956777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 568/1142] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:30:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:23.962512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974a02-53e1-4a38-9310-5ae2a74d089e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:24.055239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974a02-53e1-4a38-9310-5ae2a74d089e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:24.086070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d84965-cd97-4d32-a411-58585cad7650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:24.086862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d84965-cd97-4d32-a411-58585cad7650 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:24.087136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d84965-cd97-4d32-a411-58585cad7650 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:24.087404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d84965-cd97-4d32-a411-58585cad7650 None admin] PATH_INFO: `/v3/users/6baf110dfa4e4ae8ab2123319071bf1c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:24.100414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d84965-cd97-4d32-a411-58585cad7650 None admin] RBAC: Authorizing `identity:get_user(user_id=6baf110dfa4e4ae8ab2123319071bf1c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:24.101830 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d84965-cd97-4d32-a411-58585cad7650 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:24.103460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 575/1143] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:23 2022] GET /identity/v3/users/6baf110dfa4e4ae8ab2123319071bf1c => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:24.109150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de70a9-741d-4ae3-9fd3-2cf49e3010a0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:24.205082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de70a9-741d-4ae3-9fd3-2cf49e3010a0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:24.239958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248f7b0-6ee1-4455-8641-c019124cd077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:24.240604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248f7b0-6ee1-4455-8641-c019124cd077 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:24.240892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248f7b0-6ee1-4455-8641-c019124cd077 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:24.241167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248f7b0-6ee1-4455-8641-c019124cd077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:24.304030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248f7b0-6ee1-4455-8641-c019124cd077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:24.305467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248f7b0-6ee1-4455-8641-c019124cd077 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:24.396928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 569/1144] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:30:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:30:24.402896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d84965-cd97-4d32-a411-58585cad7650 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:24.496434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d84965-cd97-4d32-a411-58585cad7650 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:24.527654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f749976-b731-4832-85d5-b78f6fca7e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:24.528492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749976-b731-4832-85d5-b78f6fca7e04 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:24.528769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749976-b731-4832-85d5-b78f6fca7e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:24.529037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749976-b731-4832-85d5-b78f6fca7e04 None admin] PATH_INFO: `/v3/projects/35f574f674dd4435a605e8a228b66d54` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:24.530217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f749976-b731-4832-85d5-b78f6fca7e04 None admin] RBAC: Authorizing `identity:get_project(project_id=35f574f674dd4435a605e8a228b66d54)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:24.531667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f749976-b731-4832-85d5-b78f6fca7e04 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:24.533322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 576/1145] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:24 2022] GET /identity/v3/projects/35f574f674dd4435a605e8a228b66d54 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:24.539318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248f7b0-6ee1-4455-8641-c019124cd077 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:24.632614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248f7b0-6ee1-4455-8641-c019124cd077 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:24.664132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac2eb6-80cd-48d4-8fbd-039eaf8e526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:24.664724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac2eb6-80cd-48d4-8fbd-039eaf8e526b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:24.665009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac2eb6-80cd-48d4-8fbd-039eaf8e526b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:24.665284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac2eb6-80cd-48d4-8fbd-039eaf8e526b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:24.666135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac2eb6-80cd-48d4-8fbd-039eaf8e526b None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=35f574f674dd4435a605e8a228b66d54, user.id=6baf110dfa4e4ae8ab2123319071bf1c) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:24.666446 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac2eb6-80cd-48d4-8fbd-039eaf8e526b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:24.668411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac2eb6-80cd-48d4-8fbd-039eaf8e526b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:24.673568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 570/1146] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:30:24 2022] GET /identity/v3/role_assignments?user.id=6baf110dfa4e4ae8ab2123319071bf1c&scope.project.id=35f574f674dd4435a605e8a228b66d54&role.id=cb77715547a14bae950f68513af00d30 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:26.831230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f0dfb-f25a-4eec-ab94-91e78ae23ac5 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:26.831797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f0dfb-f25a-4eec-ab94-91e78ae23ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:26.831797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f0dfb-f25a-4eec-ab94-91e78ae23ac5 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:26.833149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 577/1147] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:26.838239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74308833-f156-4673-8391-05ba28351291 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:26.838658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74308833-f156-4673-8391-05ba28351291 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:26.838794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74308833-f156-4673-8391-05ba28351291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:26.856215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-74308833-f156-4673-8391-05ba28351291 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:26.857399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-74308833-f156-4673-8391-05ba28351291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:26.919916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 571/1148] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:26.941786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f0dfb-f25a-4eec-ab94-91e78ae23ac5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:27.036074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f0dfb-f25a-4eec-ab94-91e78ae23ac5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:27.067597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1361704-8527-4102-ab81-a92c92ff5d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:27.068371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1361704-8527-4102-ab81-a92c92ff5d6c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:27.068654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1361704-8527-4102-ab81-a92c92ff5d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:27.068928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1361704-8527-4102-ab81-a92c92ff5d6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:27.079144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1361704-8527-4102-ab81-a92c92ff5d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a1361704-8527-4102-ab81-a92c92ff5d6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:30:27.086719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:27.087896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:27.088949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 578/1149] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:30:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:27.094284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74308833-f156-4673-8391-05ba28351291 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:27.185616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74308833-f156-4673-8391-05ba28351291 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:27.217845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d70f47-fc95-43f1-a7f0-51c6d8a91e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:27.218618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70f47-fc95-43f1-a7f0-51c6d8a91e52 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:27.218926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70f47-fc95-43f1-a7f0-51c6d8a91e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:27.219199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70f47-fc95-43f1-a7f0-51c6d8a91e52 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:27.219943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d70f47-fc95-43f1-a7f0-51c6d8a91e52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:27.220248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d70f47-fc95-43f1-a7f0-51c6d8a91e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:27.221857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d70f47-fc95-43f1-a7f0-51c6d8a91e52 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:27.229699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 572/1150] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:27.235669 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1361704-8527-4102-ab81-a92c92ff5d6c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:27.328222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1361704-8527-4102-ab81-a92c92ff5d6c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:27.359986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a80e0-b57e-4dad-b1c5-95ca95e9ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:27.360833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a80e0-b57e-4dad-b1c5-95ca95e9ac0d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:27.361109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a80e0-b57e-4dad-b1c5-95ca95e9ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:27.361376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a80e0-b57e-4dad-b1c5-95ca95e9ac0d None admin] PATH_INFO: `/v3/users/6baf110dfa4e4ae8ab2123319071bf1c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:27.362550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a80e0-b57e-4dad-b1c5-95ca95e9ac0d None admin] RBAC: Authorizing `identity:get_user(user_id=6baf110dfa4e4ae8ab2123319071bf1c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:27.363959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a80e0-b57e-4dad-b1c5-95ca95e9ac0d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:27.365540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 579/1151] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:27 2022] GET /identity/v3/users/6baf110dfa4e4ae8ab2123319071bf1c => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:27.371857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d70f47-fc95-43f1-a7f0-51c6d8a91e52 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:27.465373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d70f47-fc95-43f1-a7f0-51c6d8a91e52 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:27.496866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e50da-5444-4c2a-b430-d1835d714c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:27.497702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e50da-5444-4c2a-b430-d1835d714c48 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:27.497985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e50da-5444-4c2a-b430-d1835d714c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:27.498283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e50da-5444-4c2a-b430-d1835d714c48 None admin] PATH_INFO: `/v3/projects/35f574f674dd4435a605e8a228b66d54` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:27.499460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e50da-5444-4c2a-b430-d1835d714c48 None admin] RBAC: Authorizing `identity:get_project(project_id=35f574f674dd4435a605e8a228b66d54)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:27.500874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e50da-5444-4c2a-b430-d1835d714c48 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:27.502574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 573/1152] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:27 2022] GET /identity/v3/projects/35f574f674dd4435a605e8a228b66d54 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:27.508348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a80e0-b57e-4dad-b1c5-95ca95e9ac0d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:27.603029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a80e0-b57e-4dad-b1c5-95ca95e9ac0d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:27.637886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45294d-1f32-41b5-8247-b3a8b693566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:27.638733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45294d-1f32-41b5-8247-b3a8b693566f None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:27.639016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45294d-1f32-41b5-8247-b3a8b693566f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:27.639298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45294d-1f32-41b5-8247-b3a8b693566f None admin] PATH_INFO: `/v3/projects/35f574f674dd4435a605e8a228b66d54/users/6baf110dfa4e4ae8ab2123319071bf1c/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:27.641447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45294d-1f32-41b5-8247-b3a8b693566f None admin] RBAC: Authorizing `identity:create_grant(project_id=35f574f674dd4435a605e8a228b66d54, user_id=6baf110dfa4e4ae8ab2123319071bf1c, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:27.642917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45294d-1f32-41b5-8247-b3a8b693566f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:27.656039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 580/1153] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:30:27 2022] PUT /identity/v3/projects/35f574f674dd4435a605e8a228b66d54/users/6baf110dfa4e4ae8ab2123319071bf1c/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:30:29.818850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b2550-ea75-420a-a0c3-3d0f2ec15bef None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:29.819367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b2550-ea75-420a-a0c3-3d0f2ec15bef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:29.819458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b2550-ea75-420a-a0c3-3d0f2ec15bef None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:29.820754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 574/1154] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:29.826610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb98c1e-4593-401d-9692-5acb5ce85efd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:29.827030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb98c1e-4593-401d-9692-5acb5ce85efd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:29.827153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb98c1e-4593-401d-9692-5acb5ce85efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:29.843191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6fb98c1e-4593-401d-9692-5acb5ce85efd None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:29.844346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6fb98c1e-4593-401d-9692-5acb5ce85efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:29.906133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 581/1155] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:29.928928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b2550-ea75-420a-a0c3-3d0f2ec15bef None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:30.025524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b2550-ea75-420a-a0c3-3d0f2ec15bef None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:30.056529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfef3cf-0918-4d6a-b20b-000a952d0bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:30.057296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfef3cf-0918-4d6a-b20b-000a952d0bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:30.057577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfef3cf-0918-4d6a-b20b-000a952d0bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:30.058464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfef3cf-0918-4d6a-b20b-000a952d0bc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:30.069051 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfef3cf-0918-4d6a-b20b-000a952d0bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1dfef3cf-0918-4d6a-b20b-000a952d0bc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:30:30.076457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:30.077474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:30:30.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 575/1156] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:30.083681 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb98c1e-4593-401d-9692-5acb5ce85efd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:30.175459 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb98c1e-4593-401d-9692-5acb5ce85efd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:30.206757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335be9d-f2c8-4bb4-9465-cf558f81be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:30.207412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335be9d-f2c8-4bb4-9465-cf558f81be3f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:30.207691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335be9d-f2c8-4bb4-9465-cf558f81be3f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:30.207959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335be9d-f2c8-4bb4-9465-cf558f81be3f None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:30.208683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335be9d-f2c8-4bb4-9465-cf558f81be3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:30.208980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335be9d-f2c8-4bb4-9465-cf558f81be3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:30.210370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335be9d-f2c8-4bb4-9465-cf558f81be3f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:30.217872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 582/1157] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:30.223799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfef3cf-0918-4d6a-b20b-000a952d0bc3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:30.315449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfef3cf-0918-4d6a-b20b-000a952d0bc3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:30.347073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dceba-0d53-4fb9-98a7-19d98ae975a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:30.348153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dceba-0d53-4fb9-98a7-19d98ae975a3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:30.348427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dceba-0d53-4fb9-98a7-19d98ae975a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:30.348693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dceba-0d53-4fb9-98a7-19d98ae975a3 None admin] PATH_INFO: `/v3/users/6baf110dfa4e4ae8ab2123319071bf1c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:30.349862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dceba-0d53-4fb9-98a7-19d98ae975a3 None admin] RBAC: Authorizing `identity:get_user(user_id=6baf110dfa4e4ae8ab2123319071bf1c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:30.351491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dceba-0d53-4fb9-98a7-19d98ae975a3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:30.353102 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 576/1158] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:30 2022] GET /identity/v3/users/6baf110dfa4e4ae8ab2123319071bf1c => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:30.359581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335be9d-f2c8-4bb4-9465-cf558f81be3f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:30.458468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335be9d-f2c8-4bb4-9465-cf558f81be3f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:30.490857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20376ab4-d5e0-44e4-9e4d-060a551629c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:30.491488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20376ab4-d5e0-44e4-9e4d-060a551629c0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:30.491765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20376ab4-d5e0-44e4-9e4d-060a551629c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:30.492037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20376ab4-d5e0-44e4-9e4d-060a551629c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:30.557223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20376ab4-d5e0-44e4-9e4d-060a551629c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:30.558781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20376ab4-d5e0-44e4-9e4d-060a551629c0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:30.654389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 583/1159] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:30:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:30:30.660314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dceba-0d53-4fb9-98a7-19d98ae975a3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:30.756300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dceba-0d53-4fb9-98a7-19d98ae975a3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:30.789002 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c355292-8a29-4ade-bd6d-acf9ce7bb2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:30.789850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c355292-8a29-4ade-bd6d-acf9ce7bb2dd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:30.790153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c355292-8a29-4ade-bd6d-acf9ce7bb2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:30.790433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c355292-8a29-4ade-bd6d-acf9ce7bb2dd None admin] PATH_INFO: `/v3/projects/35f574f674dd4435a605e8a228b66d54` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:30.791610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c355292-8a29-4ade-bd6d-acf9ce7bb2dd None admin] RBAC: Authorizing `identity:get_project(project_id=35f574f674dd4435a605e8a228b66d54)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:30.793557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c355292-8a29-4ade-bd6d-acf9ce7bb2dd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:30.795344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 577/1160] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:30 2022] GET /identity/v3/projects/35f574f674dd4435a605e8a228b66d54 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:30.801478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20376ab4-d5e0-44e4-9e4d-060a551629c0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:30.897555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20376ab4-d5e0-44e4-9e4d-060a551629c0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:30.930252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c032df-f5df-4850-bcb0-0aa002161c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:30.930829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c032df-f5df-4850-bcb0-0aa002161c92 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:30.931113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c032df-f5df-4850-bcb0-0aa002161c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:30.931393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c032df-f5df-4850-bcb0-0aa002161c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:30.932217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c032df-f5df-4850-bcb0-0aa002161c92 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=35f574f674dd4435a605e8a228b66d54, user.id=6baf110dfa4e4ae8ab2123319071bf1c) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:30.932520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c032df-f5df-4850-bcb0-0aa002161c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:30.933982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c032df-f5df-4850-bcb0-0aa002161c92 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:30.941181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 584/1161] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:30:30 2022] GET /identity/v3/role_assignments?user.id=6baf110dfa4e4ae8ab2123319071bf1c&scope.project.id=35f574f674dd4435a605e8a228b66d54&role.id=cb77715547a14bae950f68513af00d30 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:33.175903 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2ca49-eacc-4fd7-ab43-b479104c0ab2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:33.176428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2ca49-eacc-4fd7-ab43-b479104c0ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:33.176428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2ca49-eacc-4fd7-ab43-b479104c0ab2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:33.177808 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 578/1162] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:33.183320 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec54a5-c9cb-492a-ba10-916a302d3b5f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:33.183759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec54a5-c9cb-492a-ba10-916a302d3b5f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:33.183853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec54a5-c9cb-492a-ba10-916a302d3b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:33.201976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ebec54a5-c9cb-492a-ba10-916a302d3b5f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:33.203198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ebec54a5-c9cb-492a-ba10-916a302d3b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:33.269863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 585/1163] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:33.292477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2ca49-eacc-4fd7-ab43-b479104c0ab2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:33.391787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2ca49-eacc-4fd7-ab43-b479104c0ab2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:33.424956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2e2ec-bee6-4626-ae98-88680e9bfd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:33.425543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2e2ec-bee6-4626-ae98-88680e9bfd3e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:33.425827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2e2ec-bee6-4626-ae98-88680e9bfd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:33.426134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2e2ec-bee6-4626-ae98-88680e9bfd3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:33.491939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2e2ec-bee6-4626-ae98-88680e9bfd3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:33.493375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2e2ec-bee6-4626-ae98-88680e9bfd3e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:33.586837 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 579/1164] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:30:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:30:33.593071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec54a5-c9cb-492a-ba10-916a302d3b5f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:33.694956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec54a5-c9cb-492a-ba10-916a302d3b5f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:33.727797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f99e28-e7a6-447f-98f9-378852922bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:33.728592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99e28-e7a6-447f-98f9-378852922bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:33.728870 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99e28-e7a6-447f-98f9-378852922bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:33.729145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99e28-e7a6-447f-98f9-378852922bb2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:33.735682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f99e28-e7a6-447f-98f9-378852922bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:33.737115 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f99e28-e7a6-447f-98f9-378852922bb2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-06f99e28-e7a6-447f-98f9-378852922bb2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:33.751634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:33.752950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:33.753952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 586/1165] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:30:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:33.758887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2e2ec-bee6-4626-ae98-88680e9bfd3e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:33.855938 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2e2ec-bee6-4626-ae98-88680e9bfd3e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:33.890140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5591b7-11cc-4cf2-983e-95b16dd7c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:33.890794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5591b7-11cc-4cf2-983e-95b16dd7c74e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:33.891069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5591b7-11cc-4cf2-983e-95b16dd7c74e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:33.891334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5591b7-11cc-4cf2-983e-95b16dd7c74e None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:33.892048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5591b7-11cc-4cf2-983e-95b16dd7c74e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:33.892357 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5591b7-11cc-4cf2-983e-95b16dd7c74e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:33.893709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5591b7-11cc-4cf2-983e-95b16dd7c74e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:33.901040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 580/1166] 10.222.0.75 () {56 vars in 1115 bytes} [Tue May 17 15:30:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:30:36.143474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df1d53-f196-4f47-9b71-db32f8e82b11 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:36.144013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df1d53-f196-4f47-9b71-db32f8e82b11 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:36.144013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df1d53-f196-4f47-9b71-db32f8e82b11 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:36.145361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 587/1167] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:36.150823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce66e16-f04d-464a-89b7-8b4c6d3d0799 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:36.151255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce66e16-f04d-464a-89b7-8b4c6d3d0799 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:36.151396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce66e16-f04d-464a-89b7-8b4c6d3d0799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:36.172193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5ce66e16-f04d-464a-89b7-8b4c6d3d0799 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:36.173376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5ce66e16-f04d-464a-89b7-8b4c6d3d0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:36.235719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 581/1168] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:36.258712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df1d53-f196-4f47-9b71-db32f8e82b11 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:36.356737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df1d53-f196-4f47-9b71-db32f8e82b11 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:36.387854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148ab31-1458-4d27-bd9e-150fed321376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:36.388508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148ab31-1458-4d27-bd9e-150fed321376 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:36.388789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148ab31-1458-4d27-bd9e-150fed321376 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:36.389060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148ab31-1458-4d27-bd9e-150fed321376 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:36.389783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148ab31-1458-4d27-bd9e-150fed321376 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:36.391176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148ab31-1458-4d27-bd9e-150fed321376 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:36.407903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 588/1169] 10.222.0.75 () {60 vars in 1138 bytes} [Tue May 17 15:30:36 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:30:38.801377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61e699-1778-4c18-ada5-bf9563566a0d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:38.801907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61e699-1778-4c18-ada5-bf9563566a0d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:38.801907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61e699-1778-4c18-ada5-bf9563566a0d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:38.803296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 582/1170] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:38.808842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39770b-8eee-4c7e-bf34-a40775cc9fb3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:38.809235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39770b-8eee-4c7e-bf34-a40775cc9fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:38.809396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39770b-8eee-4c7e-bf34-a40775cc9fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:38.825450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9e39770b-8eee-4c7e-bf34-a40775cc9fb3 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:38.826627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9e39770b-8eee-4c7e-bf34-a40775cc9fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:38.887690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 589/1171] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:38.910700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61e699-1778-4c18-ada5-bf9563566a0d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:39.003661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61e699-1778-4c18-ada5-bf9563566a0d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:39.034954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6de77f-289f-4dc3-8942-22909f8793ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:39.035821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6de77f-289f-4dc3-8942-22909f8793ac None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:39.036101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6de77f-289f-4dc3-8942-22909f8793ac None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:39.036372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6de77f-289f-4dc3-8942-22909f8793ac None admin] PATH_INFO: `/v3/domains/3f1840e6efb9462b8f637933c1f91303` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:39.046689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6de77f-289f-4dc3-8942-22909f8793ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=3f1840e6efb9462b8f637933c1f91303)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:39.048138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6de77f-289f-4dc3-8942-22909f8793ac None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:39.049740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 583/1172] 10.222.0.75 () {56 vars in 1183 bytes} [Tue May 17 15:30:38 2022] GET /identity/v3/domains/3f1840e6efb9462b8f637933c1f91303 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:39.055354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39770b-8eee-4c7e-bf34-a40775cc9fb3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:39.146514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39770b-8eee-4c7e-bf34-a40775cc9fb3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:39.177709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c39d22-2566-4937-b536-ec19ff7bbe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:39.178376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39d22-2566-4937-b536-ec19ff7bbe5b None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:39.178654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39d22-2566-4937-b536-ec19ff7bbe5b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:39.178923 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39d22-2566-4937-b536-ec19ff7bbe5b None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:39.179604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c39d22-2566-4937-b536-ec19ff7bbe5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:39.181020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c39d22-2566-4937-b536-ec19ff7bbe5b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:39.205760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 590/1173] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:30:39 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:30:41.465296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280de16-1b9a-4ab4-bed8-6c9ac10175a8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:41.465825 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280de16-1b9a-4ab4-bed8-6c9ac10175a8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:41.465825 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280de16-1b9a-4ab4-bed8-6c9ac10175a8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:41.467167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 584/1174] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:41.472775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d5622-d98f-4f6e-b4f9-f207eee9a92f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:41.473156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d5622-d98f-4f6e-b4f9-f207eee9a92f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:41.473325 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d5622-d98f-4f6e-b4f9-f207eee9a92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:41.489343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-324d5622-d98f-4f6e-b4f9-f207eee9a92f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:41.490534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-324d5622-d98f-4f6e-b4f9-f207eee9a92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:41.551732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 591/1175] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:41.576699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280de16-1b9a-4ab4-bed8-6c9ac10175a8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:41.671273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280de16-1b9a-4ab4-bed8-6c9ac10175a8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:41.702768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7ef7a-dc87-45dd-a3be-9a57b2fd7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:41.703604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ef7a-dc87-45dd-a3be-9a57b2fd7162 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:41.703887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ef7a-dc87-45dd-a3be-9a57b2fd7162 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:41.704160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ef7a-dc87-45dd-a3be-9a57b2fd7162 None admin] PATH_INFO: `/v3/domains/3f1840e6efb9462b8f637933c1f91303` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:41.705327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7ef7a-dc87-45dd-a3be-9a57b2fd7162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3f1840e6efb9462b8f637933c1f91303)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:41.706763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7ef7a-dc87-45dd-a3be-9a57b2fd7162 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:41.708340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 585/1176] 10.222.0.75 () {56 vars in 1183 bytes} [Tue May 17 15:30:41 2022] GET /identity/v3/domains/3f1840e6efb9462b8f637933c1f91303 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:41.713781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d5622-d98f-4f6e-b4f9-f207eee9a92f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:41.808192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d5622-d98f-4f6e-b4f9-f207eee9a92f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:41.839415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29193-1ad6-4693-8395-d2f2e0fb8dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:41.840059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29193-1ad6-4693-8395-d2f2e0fb8dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:41.840335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29193-1ad6-4693-8395-d2f2e0fb8dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:41.840605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29193-1ad6-4693-8395-d2f2e0fb8dc7 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:41.841288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a29193-1ad6-4693-8395-d2f2e0fb8dc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:41.842729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a29193-1ad6-4693-8395-d2f2e0fb8dc7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:41.861512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 592/1177] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:30:41 2022] POST /identity/v3/users => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:30:44.099536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ac769-9b79-474e-9ce3-ba7790dd8121 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:44.100088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ac769-9b79-474e-9ce3-ba7790dd8121 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:44.100088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ac769-9b79-474e-9ce3-ba7790dd8121 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:44.101434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 586/1178] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:44.107387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97c945-01d4-4f34-a909-ca646b2e30a5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:44.107754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97c945-01d4-4f34-a909-ca646b2e30a5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:44.107943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97c945-01d4-4f34-a909-ca646b2e30a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:44.124055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dd97c945-01d4-4f34-a909-ca646b2e30a5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:44.125260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dd97c945-01d4-4f34-a909-ca646b2e30a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:44.187958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 593/1179] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:44.212737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ac769-9b79-474e-9ce3-ba7790dd8121 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:44.309000 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ac769-9b79-474e-9ce3-ba7790dd8121 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:44.341275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186691c-0e73-44e8-bd3b-f5d749307f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:44.342061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186691c-0e73-44e8-bd3b-f5d749307f23 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:44.342346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186691c-0e73-44e8-bd3b-f5d749307f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:44.342621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186691c-0e73-44e8-bd3b-f5d749307f23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:44.352968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186691c-0e73-44e8-bd3b-f5d749307f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3186691c-0e73-44e8-bd3b-f5d749307f23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:30:44.360461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:44.361621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:30:44.362723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 587/1180] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:30:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:44.367738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97c945-01d4-4f34-a909-ca646b2e30a5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:44.458487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97c945-01d4-4f34-a909-ca646b2e30a5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:44.490160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515148ee-3983-4702-88b9-ec3f1944fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:44.490808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515148ee-3983-4702-88b9-ec3f1944fc59 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:44.491084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515148ee-3983-4702-88b9-ec3f1944fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:44.491352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515148ee-3983-4702-88b9-ec3f1944fc59 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:44.492077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515148ee-3983-4702-88b9-ec3f1944fc59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:44.492375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515148ee-3983-4702-88b9-ec3f1944fc59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:44.493729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515148ee-3983-4702-88b9-ec3f1944fc59 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:44.501247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 594/1181] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:30:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:44.506736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186691c-0e73-44e8-bd3b-f5d749307f23 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:44.597395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186691c-0e73-44e8-bd3b-f5d749307f23 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:44.628325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b6f75-2da3-4247-8b1e-1913beb5c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:44.629162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b6f75-2da3-4247-8b1e-1913beb5c358 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:44.629462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b6f75-2da3-4247-8b1e-1913beb5c358 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:44.629741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b6f75-2da3-4247-8b1e-1913beb5c358 None admin] PATH_INFO: `/v3/users/1c6e71339a4d425fae9f48510a59443c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:44.642555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b6f75-2da3-4247-8b1e-1913beb5c358 None admin] RBAC: Authorizing `identity:get_user(user_id=1c6e71339a4d425fae9f48510a59443c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:44.643967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b6f75-2da3-4247-8b1e-1913beb5c358 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:44.645558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 588/1182] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:44 2022] GET /identity/v3/users/1c6e71339a4d425fae9f48510a59443c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:44.651772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515148ee-3983-4702-88b9-ec3f1944fc59 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:44.744517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515148ee-3983-4702-88b9-ec3f1944fc59 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:44.779070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6601d0a-07e4-4a3f-9711-264a71325824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:44.779738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6601d0a-07e4-4a3f-9711-264a71325824 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:44.780015 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6601d0a-07e4-4a3f-9711-264a71325824 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:44.780284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6601d0a-07e4-4a3f-9711-264a71325824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:44.841971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6601d0a-07e4-4a3f-9711-264a71325824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:44.843424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6601d0a-07e4-4a3f-9711-264a71325824 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:44.931948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 595/1183] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:30:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:30:44.938356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b6f75-2da3-4247-8b1e-1913beb5c358 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:45.030006 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b6f75-2da3-4247-8b1e-1913beb5c358 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:45.062212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65e9da-752e-4f2c-8be0-43bd05bfec0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:45.063109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65e9da-752e-4f2c-8be0-43bd05bfec0d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:45.063325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65e9da-752e-4f2c-8be0-43bd05bfec0d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:45.063593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65e9da-752e-4f2c-8be0-43bd05bfec0d None admin] PATH_INFO: `/v3/projects/884b9b2b397c4afc8516a2018b5362e0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:45.064732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65e9da-752e-4f2c-8be0-43bd05bfec0d None admin] RBAC: Authorizing `identity:get_project(project_id=884b9b2b397c4afc8516a2018b5362e0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:45.066178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65e9da-752e-4f2c-8be0-43bd05bfec0d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:45.067830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 589/1184] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:44 2022] GET /identity/v3/projects/884b9b2b397c4afc8516a2018b5362e0 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:45.073825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6601d0a-07e4-4a3f-9711-264a71325824 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:45.165347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6601d0a-07e4-4a3f-9711-264a71325824 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:45.198335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b2053-132b-453c-ad52-71ad32f03a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:45.198909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b2053-132b-453c-ad52-71ad32f03a15 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:45.199188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b2053-132b-453c-ad52-71ad32f03a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:45.199462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b2053-132b-453c-ad52-71ad32f03a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:45.200274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b2053-132b-453c-ad52-71ad32f03a15 None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=884b9b2b397c4afc8516a2018b5362e0, user.id=1c6e71339a4d425fae9f48510a59443c) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:45.200581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b2053-132b-453c-ad52-71ad32f03a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:45.202024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b2053-132b-453c-ad52-71ad32f03a15 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:45.207223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 596/1185] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:30:45 2022] GET /identity/v3/role_assignments?user.id=1c6e71339a4d425fae9f48510a59443c&scope.project.id=884b9b2b397c4afc8516a2018b5362e0&role.id=cb77715547a14bae950f68513af00d30 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:47.374768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96f922-a1cf-450d-ad30-5f1555a40255 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:47.375300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96f922-a1cf-450d-ad30-5f1555a40255 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:47.375300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96f922-a1cf-450d-ad30-5f1555a40255 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:47.376643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 590/1186] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:47.381904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0892-bb26-45e5-b1fa-9da49a706101 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:47.382305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0892-bb26-45e5-b1fa-9da49a706101 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:47.382492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0892-bb26-45e5-b1fa-9da49a706101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:47.398581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ff0a0892-bb26-45e5-b1fa-9da49a706101 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:47.399705 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ff0a0892-bb26-45e5-b1fa-9da49a706101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:47.467857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 597/1187] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:47.490932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96f922-a1cf-450d-ad30-5f1555a40255 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:47.585111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96f922-a1cf-450d-ad30-5f1555a40255 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:47.616892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbb3d2-3daf-4bc9-a49a-e15fc3f7d64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:47.617658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbb3d2-3daf-4bc9-a49a-e15fc3f7d64b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:47.617937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbb3d2-3daf-4bc9-a49a-e15fc3f7d64b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:47.618239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbb3d2-3daf-4bc9-a49a-e15fc3f7d64b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:47.628671 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbb3d2-3daf-4bc9-a49a-e15fc3f7d64b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-03fbb3d2-3daf-4bc9-a49a-e15fc3f7d64b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:30:47.636243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:47.637344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:30:47.638317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 591/1188] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:30:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:47.643329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0892-bb26-45e5-b1fa-9da49a706101 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:47.734085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0892-bb26-45e5-b1fa-9da49a706101 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:47.764524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8e1d0-373a-4253-a5fa-1c1b67bcd1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:47.765166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8e1d0-373a-4253-a5fa-1c1b67bcd1ba None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:47.765445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8e1d0-373a-4253-a5fa-1c1b67bcd1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:47.765714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8e1d0-373a-4253-a5fa-1c1b67bcd1ba None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:47.766469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8e1d0-373a-4253-a5fa-1c1b67bcd1ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:47.766769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8e1d0-373a-4253-a5fa-1c1b67bcd1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:47.768122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8e1d0-373a-4253-a5fa-1c1b67bcd1ba None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:47.775701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 598/1189] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:30:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:47.782018 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbb3d2-3daf-4bc9-a49a-e15fc3f7d64b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:47.879787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbb3d2-3daf-4bc9-a49a-e15fc3f7d64b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:47.910714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3b583-fa4f-439d-a8ef-d87309389944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:47.911563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3b583-fa4f-439d-a8ef-d87309389944 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:47.911842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3b583-fa4f-439d-a8ef-d87309389944 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:47.912113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3b583-fa4f-439d-a8ef-d87309389944 None admin] PATH_INFO: `/v3/users/1c6e71339a4d425fae9f48510a59443c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:47.913273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3b583-fa4f-439d-a8ef-d87309389944 None admin] RBAC: Authorizing `identity:get_user(user_id=1c6e71339a4d425fae9f48510a59443c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:47.914714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3b583-fa4f-439d-a8ef-d87309389944 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:47.916320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 592/1190] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:47 2022] GET /identity/v3/users/1c6e71339a4d425fae9f48510a59443c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:47.922599 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8e1d0-373a-4253-a5fa-1c1b67bcd1ba None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:48.015507 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8e1d0-373a-4253-a5fa-1c1b67bcd1ba None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:48.047353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9540114-8f89-48c4-bdbb-137152990be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:48.048202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9540114-8f89-48c4-bdbb-137152990be1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:48.048485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9540114-8f89-48c4-bdbb-137152990be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:48.048763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9540114-8f89-48c4-bdbb-137152990be1 None admin] PATH_INFO: `/v3/projects/884b9b2b397c4afc8516a2018b5362e0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:48.049921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9540114-8f89-48c4-bdbb-137152990be1 None admin] RBAC: Authorizing `identity:get_project(project_id=884b9b2b397c4afc8516a2018b5362e0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:48.051374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9540114-8f89-48c4-bdbb-137152990be1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:48.053019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 599/1191] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:47 2022] GET /identity/v3/projects/884b9b2b397c4afc8516a2018b5362e0 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:48.058685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3b583-fa4f-439d-a8ef-d87309389944 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:48.163570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3b583-fa4f-439d-a8ef-d87309389944 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:48.194255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d375a2-c733-4f66-8447-9c0e218d268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:48.195128 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d375a2-c733-4f66-8447-9c0e218d268e None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:48.195407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d375a2-c733-4f66-8447-9c0e218d268e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:48.195678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d375a2-c733-4f66-8447-9c0e218d268e None admin] PATH_INFO: `/v3/projects/884b9b2b397c4afc8516a2018b5362e0/users/1c6e71339a4d425fae9f48510a59443c/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:48.197612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d375a2-c733-4f66-8447-9c0e218d268e None admin] RBAC: Authorizing `identity:create_grant(project_id=884b9b2b397c4afc8516a2018b5362e0, user_id=1c6e71339a4d425fae9f48510a59443c, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:48.199582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d375a2-c733-4f66-8447-9c0e218d268e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:48.211564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 593/1192] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:30:48 2022] PUT /identity/v3/projects/884b9b2b397c4afc8516a2018b5362e0/users/1c6e71339a4d425fae9f48510a59443c/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:30:50.388339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14231193-af17-47f5-912a-f32cea09b53f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:50.388863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14231193-af17-47f5-912a-f32cea09b53f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:50.388863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14231193-af17-47f5-912a-f32cea09b53f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:50.390281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 600/1193] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:30:50.395459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f36f3b-c357-432d-be6d-cd09e8ec730d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:50.395823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f36f3b-c357-432d-be6d-cd09e8ec730d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:50.395964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f36f3b-c357-432d-be6d-cd09e8ec730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:50.412262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-78f36f3b-c357-432d-be6d-cd09e8ec730d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:30:50.413445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-78f36f3b-c357-432d-be6d-cd09e8ec730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:30:50.475960 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 594/1194] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:30:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:30:50.502589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14231193-af17-47f5-912a-f32cea09b53f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:50.596873 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14231193-af17-47f5-912a-f32cea09b53f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:50.629783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed6ebb-cacd-4b9e-80d4-3fbabdaef31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:50.630590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6ebb-cacd-4b9e-80d4-3fbabdaef31b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:50.630875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6ebb-cacd-4b9e-80d4-3fbabdaef31b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:50.631156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6ebb-cacd-4b9e-80d4-3fbabdaef31b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:50.641211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed6ebb-cacd-4b9e-80d4-3fbabdaef31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-96ed6ebb-cacd-4b9e-80d4-3fbabdaef31b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:30:50.648843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:30:50.649931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:30:50.650988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 601/1195] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:30:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:30:50.655892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f36f3b-c357-432d-be6d-cd09e8ec730d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:50.748834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f36f3b-c357-432d-be6d-cd09e8ec730d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:50.785046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bc830-ec0b-4d85-948c-ffec73c924b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:50.786223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bc830-ec0b-4d85-948c-ffec73c924b3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:50.786734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bc830-ec0b-4d85-948c-ffec73c924b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:50.787234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bc830-ec0b-4d85-948c-ffec73c924b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:50.788156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bc830-ec0b-4d85-948c-ffec73c924b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:50.788466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bc830-ec0b-4d85-948c-ffec73c924b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:50.789849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bc830-ec0b-4d85-948c-ffec73c924b3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:50.798510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 595/1196] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:30:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:50.804350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed6ebb-cacd-4b9e-80d4-3fbabdaef31b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:50.897602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed6ebb-cacd-4b9e-80d4-3fbabdaef31b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:50.930074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153d700-de2f-4628-affe-33216de6eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:50.930946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153d700-de2f-4628-affe-33216de6eb66 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:50.931226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153d700-de2f-4628-affe-33216de6eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:50.931500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153d700-de2f-4628-affe-33216de6eb66 None admin] PATH_INFO: `/v3/users/1c6e71339a4d425fae9f48510a59443c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:50.932672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153d700-de2f-4628-affe-33216de6eb66 None admin] RBAC: Authorizing `identity:get_user(user_id=1c6e71339a4d425fae9f48510a59443c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:50.934134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153d700-de2f-4628-affe-33216de6eb66 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:50.935741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 602/1197] 10.222.0.75 () {56 vars in 1177 bytes} [Tue May 17 15:30:50 2022] GET /identity/v3/users/1c6e71339a4d425fae9f48510a59443c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:50.941369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bc830-ec0b-4d85-948c-ffec73c924b3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:51.034428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bc830-ec0b-4d85-948c-ffec73c924b3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:51.065664 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbafc-d4c9-4b54-b5e3-bf58fd25c4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:51.066321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbafc-d4c9-4b54-b5e3-bf58fd25c4aa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:51.066601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbafc-d4c9-4b54-b5e3-bf58fd25c4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:51.066872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbafc-d4c9-4b54-b5e3-bf58fd25c4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:51.140616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dbafc-d4c9-4b54-b5e3-bf58fd25c4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:51.142141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dbafc-d4c9-4b54-b5e3-bf58fd25c4aa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:51.236177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 596/1198] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:30:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:30:51.241896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153d700-de2f-4628-affe-33216de6eb66 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:51.335670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153d700-de2f-4628-affe-33216de6eb66 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:51.367871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557d134-89a9-422a-ae46-5cae956d2ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:51.368721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557d134-89a9-422a-ae46-5cae956d2ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:51.369001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557d134-89a9-422a-ae46-5cae956d2ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:51.369274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557d134-89a9-422a-ae46-5cae956d2ac9 None admin] PATH_INFO: `/v3/projects/884b9b2b397c4afc8516a2018b5362e0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:51.370462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557d134-89a9-422a-ae46-5cae956d2ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=884b9b2b397c4afc8516a2018b5362e0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:51.371895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557d134-89a9-422a-ae46-5cae956d2ac9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:51.373572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 603/1199] 10.222.0.75 () {56 vars in 1186 bytes} [Tue May 17 15:30:51 2022] GET /identity/v3/projects/884b9b2b397c4afc8516a2018b5362e0 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:30:51.379583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbafc-d4c9-4b54-b5e3-bf58fd25c4aa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:30:51.472910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbafc-d4c9-4b54-b5e3-bf58fd25c4aa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:30:51.504691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68352140-df2f-4187-9e33-86ce11817abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:30:51.505273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68352140-df2f-4187-9e33-86ce11817abc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:30:51.505551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68352140-df2f-4187-9e33-86ce11817abc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:30:51.505821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68352140-df2f-4187-9e33-86ce11817abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:30:51.506675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68352140-df2f-4187-9e33-86ce11817abc None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=884b9b2b397c4afc8516a2018b5362e0, user.id=1c6e71339a4d425fae9f48510a59443c) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:30:51.506983 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68352140-df2f-4187-9e33-86ce11817abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:30:51.508390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68352140-df2f-4187-9e33-86ce11817abc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:30:51.514620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 597/1200] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:30:51 2022] GET /identity/v3/role_assignments?user.id=1c6e71339a4d425fae9f48510a59443c&scope.project.id=884b9b2b397c4afc8516a2018b5362e0&role.id=cb77715547a14bae950f68513af00d30 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:31:51.804166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8776bdf-9538-4009-936d-a105acfd7551 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:51.804841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8776bdf-9538-4009-936d-a105acfd7551 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:51.804841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8776bdf-9538-4009-936d-a105acfd7551 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:51.807175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 604/1201] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:31:51.812492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48fe36-7a97-4ddf-9f47-c02e1875dd62 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:51.813048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48fe36-7a97-4ddf-9f47-c02e1875dd62 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:51.813048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48fe36-7a97-4ddf-9f47-c02e1875dd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:51.831901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2f48fe36-7a97-4ddf-9f47-c02e1875dd62 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:31:51.836310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2f48fe36-7a97-4ddf-9f47-c02e1875dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:31:51.930519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 598/1202] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:31:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:31:51.951276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8776bdf-9538-4009-936d-a105acfd7551 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:52.068298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8776bdf-9538-4009-936d-a105acfd7551 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:52.107619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748057-bbd4-420b-ac57-b68a1b4e4cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:52.111643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748057-bbd4-420b-ac57-b68a1b4e4cbc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:52.111643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748057-bbd4-420b-ac57-b68a1b4e4cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:52.111643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748057-bbd4-420b-ac57-b68a1b4e4cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:52.122252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748057-bbd4-420b-ac57-b68a1b4e4cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:52.123861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748057-bbd4-420b-ac57-b68a1b4e4cbc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-03748057-bbd4-420b-ac57-b68a1b4e4cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:31:52.143886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:31:52.145223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:31:52.147012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:31:52.147012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:31:52.147012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:31:52.147012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:31:52.147012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 605/1203] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:31:52.151908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48fe36-7a97-4ddf-9f47-c02e1875dd62 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:52.269358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48fe36-7a97-4ddf-9f47-c02e1875dd62 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:52.306652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ec3f4-1023-43f9-b353-deb77340abc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:52.307305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ec3f4-1023-43f9-b353-deb77340abc0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:52.307544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ec3f4-1023-43f9-b353-deb77340abc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:52.307824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ec3f4-1023-43f9-b353-deb77340abc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:52.308581 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ec3f4-1023-43f9-b353-deb77340abc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:31:52.308883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ec3f4-1023-43f9-b353-deb77340abc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:52.310347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ec3f4-1023-43f9-b353-deb77340abc0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:52.323931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 599/1204] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:31:52.329774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748057-bbd4-420b-ac57-b68a1b4e4cbc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:52.451182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748057-bbd4-420b-ac57-b68a1b4e4cbc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:52.488064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411c83e-7e8b-42a3-9274-c318353580b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:52.489071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411c83e-7e8b-42a3-9274-c318353580b6 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:52.489564 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411c83e-7e8b-42a3-9274-c318353580b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:52.490047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411c83e-7e8b-42a3-9274-c318353580b6 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:52.491081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411c83e-7e8b-42a3-9274-c318353580b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:52.493708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411c83e-7e8b-42a3-9274-c318353580b6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:52.526047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 606/1205] 10.222.0.75 () {60 vars in 1132 bytes} [Tue May 17 15:31:52 2022] POST /identity/v3/users => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:31:54.857159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950137d3-9852-4c51-b575-a3c40984b106 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:54.857828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950137d3-9852-4c51-b575-a3c40984b106 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:54.857828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950137d3-9852-4c51-b575-a3c40984b106 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:54.859223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 600/1206] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:31:54.864661 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7b3a4-b017-4057-99b6-6a3c36bb51d2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:54.865140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7b3a4-b017-4057-99b6-6a3c36bb51d2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:54.865221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7b3a4-b017-4057-99b6-6a3c36bb51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:54.884522 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-54c7b3a4-b017-4057-99b6-6a3c36bb51d2 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:31:54.885770 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-54c7b3a4-b017-4057-99b6-6a3c36bb51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:31:54.962853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 607/1207] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:31:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:31:54.990556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950137d3-9852-4c51-b575-a3c40984b106 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:55.111613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950137d3-9852-4c51-b575-a3c40984b106 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:55.148641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9535e-99d8-47e0-bf5f-49bea9ac4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:55.149935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9535e-99d8-47e0-bf5f-49bea9ac4baf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:55.150253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9535e-99d8-47e0-bf5f-49bea9ac4baf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:55.150524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9535e-99d8-47e0-bf5f-49bea9ac4baf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:55.161307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9535e-99d8-47e0-bf5f-49bea9ac4baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-91b9535e-99d8-47e0-bf5f-49bea9ac4baf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:31:55.169349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:31:55.170650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:31:55.171742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 601/1208] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:31:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:31:55.176405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7b3a4-b017-4057-99b6-6a3c36bb51d2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:55.291269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7b3a4-b017-4057-99b6-6a3c36bb51d2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:55.330263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40d9a3-a059-4fa5-bf33-b264c3f0a43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:55.330933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d9a3-a059-4fa5-bf33-b264c3f0a43f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:55.331217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d9a3-a059-4fa5-bf33-b264c3f0a43f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:55.331485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d9a3-a059-4fa5-bf33-b264c3f0a43f None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:55.332243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40d9a3-a059-4fa5-bf33-b264c3f0a43f None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:31:55.332552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40d9a3-a059-4fa5-bf33-b264c3f0a43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:55.333933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40d9a3-a059-4fa5-bf33-b264c3f0a43f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:55.343513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 608/1209] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:31:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:31:55.349648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9535e-99d8-47e0-bf5f-49bea9ac4baf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:55.461224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9535e-99d8-47e0-bf5f-49bea9ac4baf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:55.500390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8dacf-0aad-4f72-85d3-0671f8128038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:55.501365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8dacf-0aad-4f72-85d3-0671f8128038 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:55.501642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8dacf-0aad-4f72-85d3-0671f8128038 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:55.501963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8dacf-0aad-4f72-85d3-0671f8128038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:55.516008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8dacf-0aad-4f72-85d3-0671f8128038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:55.517821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8dacf-0aad-4f72-85d3-0671f8128038 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-57a8dacf-0aad-4f72-85d3-0671f8128038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:31:55.537554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:31:55.538728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:31:55.540173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:31:55.540173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:31:55.540173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:31:55.540173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:31:55.540173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 602/1210] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:31:55.545267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40d9a3-a059-4fa5-bf33-b264c3f0a43f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:55.669417 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40d9a3-a059-4fa5-bf33-b264c3f0a43f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:55.705469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d02f95-4d0e-4e36-8373-6127a84ebfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:55.706207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d02f95-4d0e-4e36-8373-6127a84ebfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:55.706460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d02f95-4d0e-4e36-8373-6127a84ebfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:55.706727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d02f95-4d0e-4e36-8373-6127a84ebfd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:55.707433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d02f95-4d0e-4e36-8373-6127a84ebfd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:31:55.707820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d02f95-4d0e-4e36-8373-6127a84ebfd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:55.709165 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d02f95-4d0e-4e36-8373-6127a84ebfd9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:55.722759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 609/1211] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:31:55.729368 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8dacf-0aad-4f72-85d3-0671f8128038 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:55.839468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8dacf-0aad-4f72-85d3-0671f8128038 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:55.886820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03175676-a58f-4ed4-a623-c735ef664ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:55.888830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03175676-a58f-4ed4-a623-c735ef664ead None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:55.889366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03175676-a58f-4ed4-a623-c735ef664ead None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:55.890071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03175676-a58f-4ed4-a623-c735ef664ead None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:55.905834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03175676-a58f-4ed4-a623-c735ef664ead None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:55.907669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03175676-a58f-4ed4-a623-c735ef664ead None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-03175676-a58f-4ed4-a623-c735ef664ead None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:31:55.930158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:31:55.932799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 15:31:55.934840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:31:55.938042 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 603/1212] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:31:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:31:55.944359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d02f95-4d0e-4e36-8373-6127a84ebfd9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:56.063298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d02f95-4d0e-4e36-8373-6127a84ebfd9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:56.107573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d137b-ea06-4961-80a1-b491d7857f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:56.108500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d137b-ea06-4961-80a1-b491d7857f8b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:56.108790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d137b-ea06-4961-80a1-b491d7857f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:56.109122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d137b-ea06-4961-80a1-b491d7857f8b None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:56.110209 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d137b-ea06-4961-80a1-b491d7857f8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:31:56.110540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d137b-ea06-4961-80a1-b491d7857f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:56.112732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d137b-ea06-4961-80a1-b491d7857f8b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:56.137863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 610/1213] 10.222.0.75 () {56 vars in 1143 bytes} [Tue May 17 15:31:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:31:56.139201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03175676-a58f-4ed4-a623-c735ef664ead None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:56.264845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03175676-a58f-4ed4-a623-c735ef664ead None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:56.301803 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62222d4-fd16-4071-bfad-125b19e25334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:56.302727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62222d4-fd16-4071-bfad-125b19e25334 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:56.303169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62222d4-fd16-4071-bfad-125b19e25334 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:56.303591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62222d4-fd16-4071-bfad-125b19e25334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:56.379639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62222d4-fd16-4071-bfad-125b19e25334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:56.381096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62222d4-fd16-4071-bfad-125b19e25334 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:56.501330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 604/1214] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:31:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 15:31:56.507483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d137b-ea06-4961-80a1-b491d7857f8b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:56.623106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d137b-ea06-4961-80a1-b491d7857f8b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:56.662882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7f62a-f795-4402-8395-9b5722f0db44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:56.663909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7f62a-f795-4402-8395-9b5722f0db44 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:56.664320 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7f62a-f795-4402-8395-9b5722f0db44 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:56.664732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7f62a-f795-4402-8395-9b5722f0db44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:56.678281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7f62a-f795-4402-8395-9b5722f0db44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:56.680775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7f62a-f795-4402-8395-9b5722f0db44 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d3a7f62a-f795-4402-8395-9b5722f0db44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:31:56.699686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:31:56.700656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:31:56.701591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:31:56.701591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:31:56.701591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:31:56.701591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:31:56.701591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 611/1215] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:31:56.706772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62222d4-fd16-4071-bfad-125b19e25334 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:56.816480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62222d4-fd16-4071-bfad-125b19e25334 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:56.856484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fef8e-c9f2-4faa-8567-6f119c56c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:56.858284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fef8e-c9f2-4faa-8567-6f119c56c41f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:56.858284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fef8e-c9f2-4faa-8567-6f119c56c41f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:56.858284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fef8e-c9f2-4faa-8567-6f119c56c41f None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:56.858673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fef8e-c9f2-4faa-8567-6f119c56c41f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:31:56.858894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fef8e-c9f2-4faa-8567-6f119c56c41f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:56.860367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fef8e-c9f2-4faa-8567-6f119c56c41f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:56.874436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 605/1216] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:31:56.879762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7f62a-f795-4402-8395-9b5722f0db44 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:56.993205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7f62a-f795-4402-8395-9b5722f0db44 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:57.031574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7562c6-2c17-4380-bc87-51eb3c512ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:57.032783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7562c6-2c17-4380-bc87-51eb3c512ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:57.033297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7562c6-2c17-4380-bc87-51eb3c512ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:57.033803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7562c6-2c17-4380-bc87-51eb3c512ae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:57.041380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7562c6-2c17-4380-bc87-51eb3c512ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:57.043157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7562c6-2c17-4380-bc87-51eb3c512ae4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-eb7562c6-2c17-4380-bc87-51eb3c512ae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:31:57.058226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:31:57.059224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:31:57.060225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:31:57.060225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:31:57.060225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:31:57.060225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:31:57.060225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:31:57.060225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:31:57.060225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:31:57.060225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:31:57.060225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 612/1217] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:31:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:31:57.065399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fef8e-c9f2-4faa-8567-6f119c56c41f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:57.172821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fef8e-c9f2-4faa-8567-6f119c56c41f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:57.210010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d19792-7b7b-4403-b867-5bdcfb8b6aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:57.210721 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d19792-7b7b-4403-b867-5bdcfb8b6aea None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:57.211065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d19792-7b7b-4403-b867-5bdcfb8b6aea None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:57.211372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d19792-7b7b-4403-b867-5bdcfb8b6aea None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:57.212347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d19792-7b7b-4403-b867-5bdcfb8b6aea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:31:57.212699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d19792-7b7b-4403-b867-5bdcfb8b6aea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:57.214266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d19792-7b7b-4403-b867-5bdcfb8b6aea None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:57.229119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 606/1218] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:31:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:31:57.234913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7562c6-2c17-4380-bc87-51eb3c512ae4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:31:57.348517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7562c6-2c17-4380-bc87-51eb3c512ae4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:31:57.391672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d78b-40ca-4eab-be45-b4ba7d506f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:31:57.392486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d78b-40ca-4eab-be45-b4ba7d506f16 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:57.392747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d78b-40ca-4eab-be45-b4ba7d506f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:57.393148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d78b-40ca-4eab-be45-b4ba7d506f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:57.394151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d78b-40ca-4eab-be45-b4ba7d506f16 None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8614649160fb4bcca89b18ceeb6c0785) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:31:57.394468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d78b-40ca-4eab-be45-b4ba7d506f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:31:57.396204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d78b-40ca-4eab-be45-b4ba7d506f16 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:31:57.404377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 613/1219] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:31:57 2022] GET /identity/v3/role_assignments?user.id=8614649160fb4bcca89b18ceeb6c0785&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:31:59.806925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cca7a5-45c0-4789-96e5-3eb89a0689c4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:59.807564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cca7a5-45c0-4789-96e5-3eb89a0689c4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:59.807564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cca7a5-45c0-4789-96e5-3eb89a0689c4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:59.809048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 607/1220] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:31:59.814911 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f75aa-b41a-4608-bbdd-f2955fdda896 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:31:59.815385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f75aa-b41a-4608-bbdd-f2955fdda896 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:31:59.815465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f75aa-b41a-4608-bbdd-f2955fdda896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:31:59.834348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ee0f75aa-b41a-4608-bbdd-f2955fdda896 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:31:59.835533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ee0f75aa-b41a-4608-bbdd-f2955fdda896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:31:59.906597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 614/1221] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:31:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:31:59.931610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cca7a5-45c0-4789-96e5-3eb89a0689c4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:00.050736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cca7a5-45c0-4789-96e5-3eb89a0689c4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:00.087611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfd610-2eb8-491b-bf2a-4c754a61b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:00.088326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfd610-2eb8-491b-bf2a-4c754a61b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:00.088608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfd610-2eb8-491b-bf2a-4c754a61b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:00.088880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfd610-2eb8-491b-bf2a-4c754a61b8b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:00.100880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfd610-2eb8-491b-bf2a-4c754a61b8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-69dfd610-2eb8-491b-bf2a-4c754a61b8b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:32:00.113266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:00.114789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:00.116755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 608/1222] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:31:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:00.125330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f75aa-b41a-4608-bbdd-f2955fdda896 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:00.230754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f75aa-b41a-4608-bbdd-f2955fdda896 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:00.266400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b458542-2c27-4485-94b0-f90958a5786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:00.267066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b458542-2c27-4485-94b0-f90958a5786d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:00.267346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b458542-2c27-4485-94b0-f90958a5786d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:00.267622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b458542-2c27-4485-94b0-f90958a5786d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:00.268365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b458542-2c27-4485-94b0-f90958a5786d None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:00.268671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b458542-2c27-4485-94b0-f90958a5786d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:00.270154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b458542-2c27-4485-94b0-f90958a5786d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:00.279444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 615/1223] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:32:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:00.285352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfd610-2eb8-491b-bf2a-4c754a61b8b4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:00.392442 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfd610-2eb8-491b-bf2a-4c754a61b8b4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:00.429279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b4f55-714d-4407-b5d7-c0e5474da136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:00.430803 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b4f55-714d-4407-b5d7-c0e5474da136 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:00.431213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b4f55-714d-4407-b5d7-c0e5474da136 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:00.431646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b4f55-714d-4407-b5d7-c0e5474da136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:00.445460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b4f55-714d-4407-b5d7-c0e5474da136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:00.447734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b4f55-714d-4407-b5d7-c0e5474da136 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c31b4f55-714d-4407-b5d7-c0e5474da136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:00.468151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:00.469191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:00.470530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:00.470530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:00.470530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:00.470530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:00.470530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 609/1224] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:32:00.475710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b458542-2c27-4485-94b0-f90958a5786d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:00.580867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b458542-2c27-4485-94b0-f90958a5786d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:00.617926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4478-2ca5-4a3a-9e86-9531ee737cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:00.618860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4478-2ca5-4a3a-9e86-9531ee737cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:00.619194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4478-2ca5-4a3a-9e86-9531ee737cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:00.619410 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4478-2ca5-4a3a-9e86-9531ee737cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:00.620384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4478-2ca5-4a3a-9e86-9531ee737cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:00.620898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4478-2ca5-4a3a-9e86-9531ee737cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:00.622801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4478-2ca5-4a3a-9e86-9531ee737cd9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:00.637034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 616/1225] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:00.644744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b4f55-714d-4407-b5d7-c0e5474da136 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:00.756565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b4f55-714d-4407-b5d7-c0e5474da136 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:00.790520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22ab5a-e989-443f-b5e7-a6c79ac33944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:00.791314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22ab5a-e989-443f-b5e7-a6c79ac33944 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:00.791593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22ab5a-e989-443f-b5e7-a6c79ac33944 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:00.791862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22ab5a-e989-443f-b5e7-a6c79ac33944 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:00.799412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22ab5a-e989-443f-b5e7-a6c79ac33944 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:00.800844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22ab5a-e989-443f-b5e7-a6c79ac33944 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9f22ab5a-e989-443f-b5e7-a6c79ac33944 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:32:00.815103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:00.816750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:00.817791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 610/1226] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:00.823142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4478-2ca5-4a3a-9e86-9531ee737cd9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:00.933402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4478-2ca5-4a3a-9e86-9531ee737cd9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:00.973960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a564e-f862-4c72-84dc-52cb1565cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:00.974914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a564e-f862-4c72-84dc-52cb1565cfee None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:00.975197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a564e-f862-4c72-84dc-52cb1565cfee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:00.975477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a564e-f862-4c72-84dc-52cb1565cfee None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:00.976313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a564e-f862-4c72-84dc-52cb1565cfee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:00.976684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a564e-f862-4c72-84dc-52cb1565cfee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:00.978463 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a564e-f862-4c72-84dc-52cb1565cfee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:00.998212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 617/1227] 10.222.0.75 () {56 vars in 1143 bytes} [Tue May 17 15:32:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:01.004373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22ab5a-e989-443f-b5e7-a6c79ac33944 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:01.116735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22ab5a-e989-443f-b5e7-a6c79ac33944 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:01.157273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e132cb3-a9aa-4ec7-9820-2b7df3b551b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:01.158351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e132cb3-a9aa-4ec7-9820-2b7df3b551b1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:01.158836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e132cb3-a9aa-4ec7-9820-2b7df3b551b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:01.159155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e132cb3-a9aa-4ec7-9820-2b7df3b551b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:01.172269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e132cb3-a9aa-4ec7-9820-2b7df3b551b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:01.174082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e132cb3-a9aa-4ec7-9820-2b7df3b551b1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3e132cb3-a9aa-4ec7-9820-2b7df3b551b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:01.196872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:01.198045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:01.199156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:01.199156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:01.199156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:01.199156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:01.199156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 611/1228] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:01.203981 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a564e-f862-4c72-84dc-52cb1565cfee None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:01.312070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a564e-f862-4c72-84dc-52cb1565cfee None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:01.351996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e047392-82d6-4c26-8324-41a9a01ad2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:01.352713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e047392-82d6-4c26-8324-41a9a01ad2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:01.352995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e047392-82d6-4c26-8324-41a9a01ad2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:01.353273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e047392-82d6-4c26-8324-41a9a01ad2b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:01.354030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e047392-82d6-4c26-8324-41a9a01ad2b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:01.354338 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e047392-82d6-4c26-8324-41a9a01ad2b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:01.355946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e047392-82d6-4c26-8324-41a9a01ad2b3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:01.371334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 618/1229] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:01.377049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e132cb3-a9aa-4ec7-9820-2b7df3b551b1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:01.485672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e132cb3-a9aa-4ec7-9820-2b7df3b551b1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:01.520030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6d4a7-47c8-45f1-9e82-2b44274914f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:01.521119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6d4a7-47c8-45f1-9e82-2b44274914f5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:01.521528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6d4a7-47c8-45f1-9e82-2b44274914f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:01.521889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6d4a7-47c8-45f1-9e82-2b44274914f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:01.531512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6d4a7-47c8-45f1-9e82-2b44274914f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:01.532951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6d4a7-47c8-45f1-9e82-2b44274914f5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9ad6d4a7-47c8-45f1-9e82-2b44274914f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:32:01.549392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:01.550749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:01.552233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:32:01.552233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:32:01.552233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:32:01.552233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:32:01.552233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:32:01.552233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:32:01.552233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:01.552233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:01.552233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 612/1230] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:32:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:01.557439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e047392-82d6-4c26-8324-41a9a01ad2b3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:01.663044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e047392-82d6-4c26-8324-41a9a01ad2b3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:01.701171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf460323-79b4-4700-8bfd-457d4ddfa411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:01.701834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf460323-79b4-4700-8bfd-457d4ddfa411 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:01.702153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf460323-79b4-4700-8bfd-457d4ddfa411 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:01.702431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf460323-79b4-4700-8bfd-457d4ddfa411 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:01.703210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf460323-79b4-4700-8bfd-457d4ddfa411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:01.703519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf460323-79b4-4700-8bfd-457d4ddfa411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:01.704962 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf460323-79b4-4700-8bfd-457d4ddfa411 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:01.717898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 619/1231] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:32:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:01.724724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6d4a7-47c8-45f1-9e82-2b44274914f5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:01.827339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6d4a7-47c8-45f1-9e82-2b44274914f5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:01.863841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc078030-fc9b-4ca7-93e5-bc02c2cb974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:01.864767 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078030-fc9b-4ca7-93e5-bc02c2cb974d None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:01.864999 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078030-fc9b-4ca7-93e5-bc02c2cb974d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:01.865262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078030-fc9b-4ca7-93e5-bc02c2cb974d None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8614649160fb4bcca89b18ceeb6c0785/roles/d07b4b63f6254b2da86b74c94166cb68` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:01.879966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc078030-fc9b-4ca7-93e5-bc02c2cb974d None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=8614649160fb4bcca89b18ceeb6c0785, role_id=d07b4b63f6254b2da86b74c94166cb68)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:01.881378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc078030-fc9b-4ca7-93e5-bc02c2cb974d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:01.894200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 613/1232] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:32:01 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8614649160fb4bcca89b18ceeb6c0785/roles/d07b4b63f6254b2da86b74c94166cb68 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:32:04.171487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928379a-dde3-4dbf-9a3a-7ed34d61bf6a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:04.172038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928379a-dde3-4dbf-9a3a-7ed34d61bf6a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:04.172121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928379a-dde3-4dbf-9a3a-7ed34d61bf6a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:04.173447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 620/1233] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:32:04.179705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0b65-9267-41d0-bdc1-088ce37dfb55 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:04.180750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0b65-9267-41d0-bdc1-088ce37dfb55 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:04.180864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0b65-9267-41d0-bdc1-088ce37dfb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:04.198594 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-61ca0b65-9267-41d0-bdc1-088ce37dfb55 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:32:04.199834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-61ca0b65-9267-41d0-bdc1-088ce37dfb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:32:04.279830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 614/1234] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:32:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:32:04.304005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928379a-dde3-4dbf-9a3a-7ed34d61bf6a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:04.407811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928379a-dde3-4dbf-9a3a-7ed34d61bf6a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:04.442294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0030-3c21-4584-96e7-f139e3f91700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:04.443076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0030-3c21-4584-96e7-f139e3f91700 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:04.443351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0030-3c21-4584-96e7-f139e3f91700 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:04.443618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0030-3c21-4584-96e7-f139e3f91700 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:04.454306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd0030-3c21-4584-96e7-f139e3f91700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e1bd0030-3c21-4584-96e7-f139e3f91700 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:32:04.462948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:04.464208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:04.470773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 621/1235] 10.222.0.75 () {56 vars in 1102 bytes} [Tue May 17 15:32:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:04.471686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0b65-9267-41d0-bdc1-088ce37dfb55 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:04.586381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0b65-9267-41d0-bdc1-088ce37dfb55 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:04.622261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca90456-a9bb-480a-8a7d-99e7bb03ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:04.622928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca90456-a9bb-480a-8a7d-99e7bb03ff22 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:04.623326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca90456-a9bb-480a-8a7d-99e7bb03ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:04.623821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca90456-a9bb-480a-8a7d-99e7bb03ff22 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:04.624843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca90456-a9bb-480a-8a7d-99e7bb03ff22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:04.625348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca90456-a9bb-480a-8a7d-99e7bb03ff22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:04.627125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca90456-a9bb-480a-8a7d-99e7bb03ff22 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:04.636554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 615/1236] 10.222.0.75 () {56 vars in 1103 bytes} [Tue May 17 15:32:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:04.642757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0030-3c21-4584-96e7-f139e3f91700 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:04.760404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0030-3c21-4584-96e7-f139e3f91700 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:04.796360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb753ed-b562-422c-96e3-4ce4dc9581bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:04.797243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb753ed-b562-422c-96e3-4ce4dc9581bc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:04.797571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb753ed-b562-422c-96e3-4ce4dc9581bc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:04.797847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb753ed-b562-422c-96e3-4ce4dc9581bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:04.809525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb753ed-b562-422c-96e3-4ce4dc9581bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:04.811248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb753ed-b562-422c-96e3-4ce4dc9581bc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-deb753ed-b562-422c-96e3-4ce4dc9581bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:04.828408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:04.829548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:04.830532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:04.830532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:04.830532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:04.830532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:04.830532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 622/1237] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:04.835489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca90456-a9bb-480a-8a7d-99e7bb03ff22 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:04.951008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca90456-a9bb-480a-8a7d-99e7bb03ff22 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:04.990054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585150c-293c-4808-a9dc-48fe9492801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:04.990951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585150c-293c-4808-a9dc-48fe9492801e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:04.991342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585150c-293c-4808-a9dc-48fe9492801e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:04.991612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585150c-293c-4808-a9dc-48fe9492801e None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:04.992649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585150c-293c-4808-a9dc-48fe9492801e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:04.993026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585150c-293c-4808-a9dc-48fe9492801e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:04.994923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585150c-293c-4808-a9dc-48fe9492801e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:05.008389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 616/1238] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:05.014069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb753ed-b562-422c-96e3-4ce4dc9581bc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:05.129283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb753ed-b562-422c-96e3-4ce4dc9581bc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:05.170812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8993-e5c8-4048-a44e-52a304844392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:05.171619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8993-e5c8-4048-a44e-52a304844392 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:05.172140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8993-e5c8-4048-a44e-52a304844392 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:05.172228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8993-e5c8-4048-a44e-52a304844392 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:05.181225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d8993-e5c8-4048-a44e-52a304844392 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:05.182737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d8993-e5c8-4048-a44e-52a304844392 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-b01d8993-e5c8-4048-a44e-52a304844392 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:32:05.197926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:05.199142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:05.200127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 623/1239] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:32:05.205897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585150c-293c-4808-a9dc-48fe9492801e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:05.315078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585150c-293c-4808-a9dc-48fe9492801e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:05.353392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627610d1-c2d9-44bb-bf33-7347b42e797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:05.354132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627610d1-c2d9-44bb-bf33-7347b42e797a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:05.354548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627610d1-c2d9-44bb-bf33-7347b42e797a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:05.354838 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627610d1-c2d9-44bb-bf33-7347b42e797a None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:05.355844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627610d1-c2d9-44bb-bf33-7347b42e797a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:05.356175 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627610d1-c2d9-44bb-bf33-7347b42e797a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:05.357781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627610d1-c2d9-44bb-bf33-7347b42e797a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:05.377296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 617/1240] 10.222.0.75 () {56 vars in 1143 bytes} [Tue May 17 15:32:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:05.385817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8993-e5c8-4048-a44e-52a304844392 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:05.498799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8993-e5c8-4048-a44e-52a304844392 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:05.542074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e11ec-7e48-48cc-8b98-c3b61aa040ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:05.542742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e11ec-7e48-48cc-8b98-c3b61aa040ed None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:05.543016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e11ec-7e48-48cc-8b98-c3b61aa040ed None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:05.543286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e11ec-7e48-48cc-8b98-c3b61aa040ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:05.624328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e11ec-7e48-48cc-8b98-c3b61aa040ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:05.625781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e11ec-7e48-48cc-8b98-c3b61aa040ed None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:05.744497 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 624/1241] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:32:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:32:05.750227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627610d1-c2d9-44bb-bf33-7347b42e797a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:05.853637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627610d1-c2d9-44bb-bf33-7347b42e797a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:05.888471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881166b-7509-4839-b938-bdfbbe5801b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:05.889182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881166b-7509-4839-b938-bdfbbe5801b6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:05.889459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881166b-7509-4839-b938-bdfbbe5801b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:05.889729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881166b-7509-4839-b938-bdfbbe5801b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:05.899824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881166b-7509-4839-b938-bdfbbe5801b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:05.901350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881166b-7509-4839-b938-bdfbbe5801b6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-5881166b-7509-4839-b938-bdfbbe5801b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:05.919038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:05.920395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:05.921598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:05.921598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:05.921598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:05.921598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:05.921598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 618/1242] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:32:05.926762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e11ec-7e48-48cc-8b98-c3b61aa040ed None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:06.029913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e11ec-7e48-48cc-8b98-c3b61aa040ed None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:06.069281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58396c96-b7aa-41fc-ad12-4624f694736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:06.070201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58396c96-b7aa-41fc-ad12-4624f694736d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:06.071094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58396c96-b7aa-41fc-ad12-4624f694736d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:06.071499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58396c96-b7aa-41fc-ad12-4624f694736d None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:06.072492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58396c96-b7aa-41fc-ad12-4624f694736d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:06.072958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58396c96-b7aa-41fc-ad12-4624f694736d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:06.074716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58396c96-b7aa-41fc-ad12-4624f694736d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:06.089139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 625/1243] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:06.094603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881166b-7509-4839-b938-bdfbbe5801b6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:06.194476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881166b-7509-4839-b938-bdfbbe5801b6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:06.233515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c39de0-2f8c-4c4c-9783-08276d3d5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:06.234408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39de0-2f8c-4c4c-9783-08276d3d5298 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:06.234693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39de0-2f8c-4c4c-9783-08276d3d5298 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:06.235002 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39de0-2f8c-4c4c-9783-08276d3d5298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:06.243056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c39de0-2f8c-4c4c-9783-08276d3d5298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:06.244574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c39de0-2f8c-4c4c-9783-08276d3d5298 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a8c39de0-2f8c-4c4c-9783-08276d3d5298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:32:06.258684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:06.260022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:06.261105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:32:06.261105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:32:06.261105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:32:06.261105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:32:06.261105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:32:06.261105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:32:06.261105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:06.261105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:06.261105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 619/1244] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:32:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:32:06.266053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58396c96-b7aa-41fc-ad12-4624f694736d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:06.369453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58396c96-b7aa-41fc-ad12-4624f694736d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:06.404335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405653f-b83b-4c48-9a4b-e07276f8febd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:06.404917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405653f-b83b-4c48-9a4b-e07276f8febd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:06.405195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405653f-b83b-4c48-9a4b-e07276f8febd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:06.405461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405653f-b83b-4c48-9a4b-e07276f8febd None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:06.406268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405653f-b83b-4c48-9a4b-e07276f8febd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:06.406567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405653f-b83b-4c48-9a4b-e07276f8febd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:06.407984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405653f-b83b-4c48-9a4b-e07276f8febd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:06.420499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 626/1245] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:32:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:32:06.427307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c39de0-2f8c-4c4c-9783-08276d3d5298 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:06.531915 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c39de0-2f8c-4c4c-9783-08276d3d5298 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:06.567100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38afbe-9487-4c33-81a8-c2ef3328180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:06.567751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38afbe-9487-4c33-81a8-c2ef3328180e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:06.568035 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38afbe-9487-4c33-81a8-c2ef3328180e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:06.568315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38afbe-9487-4c33-81a8-c2ef3328180e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:06.569137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38afbe-9487-4c33-81a8-c2ef3328180e None admin] RBAC: Adding query filter params (role.id=d07b4b63f6254b2da86b74c94166cb68, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8614649160fb4bcca89b18ceeb6c0785) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:06.569446 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38afbe-9487-4c33-81a8-c2ef3328180e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:06.571507 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38afbe-9487-4c33-81a8-c2ef3328180e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:06.579833 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 620/1246] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:32:06 2022] GET /identity/v3/role_assignments?user.id=8614649160fb4bcca89b18ceeb6c0785&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=d07b4b63f6254b2da86b74c94166cb68 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:09.120034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53915f4-c834-42cf-b6ab-42eac425a21f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:09.120621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53915f4-c834-42cf-b6ab-42eac425a21f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:09.120621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53915f4-c834-42cf-b6ab-42eac425a21f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:09.121939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 627/1247] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:32:09.128669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb08c-90d6-431c-871a-ac80774432bf None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:09.129217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb08c-90d6-431c-871a-ac80774432bf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:09.129217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb08c-90d6-431c-871a-ac80774432bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:09.148918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a32cb08c-90d6-431c-871a-ac80774432bf None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:32:09.150576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a32cb08c-90d6-431c-871a-ac80774432bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:32:09.225973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 621/1248] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:32:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:32:09.254973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53915f4-c834-42cf-b6ab-42eac425a21f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:09.362386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53915f4-c834-42cf-b6ab-42eac425a21f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:09.396528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c6d8c-1672-4563-97f8-c26cc8cf850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:09.397240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6d8c-1672-4563-97f8-c26cc8cf850c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:09.397645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6d8c-1672-4563-97f8-c26cc8cf850c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:09.397810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6d8c-1672-4563-97f8-c26cc8cf850c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:09.408815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c6d8c-1672-4563-97f8-c26cc8cf850c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-954c6d8c-1672-4563-97f8-c26cc8cf850c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:32:09.416969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:09.418109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:09.419170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 628/1249] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:32:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:09.424498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb08c-90d6-431c-871a-ac80774432bf None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:09.535200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb08c-90d6-431c-871a-ac80774432bf None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:09.573952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eca8a3-225d-4504-98be-19715fd7992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:09.574655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eca8a3-225d-4504-98be-19715fd7992c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:09.574939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eca8a3-225d-4504-98be-19715fd7992c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:09.575213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eca8a3-225d-4504-98be-19715fd7992c None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:09.575985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eca8a3-225d-4504-98be-19715fd7992c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:09.576350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eca8a3-225d-4504-98be-19715fd7992c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:09.578056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eca8a3-225d-4504-98be-19715fd7992c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:09.586765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 622/1250] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:32:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:32:09.592547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c6d8c-1672-4563-97f8-c26cc8cf850c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:09.708349 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c6d8c-1672-4563-97f8-c26cc8cf850c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:09.747091 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ba9d2-cac9-4bea-9e77-de2579a42b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:09.747977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ba9d2-cac9-4bea-9e77-de2579a42b8a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:09.748276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ba9d2-cac9-4bea-9e77-de2579a42b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:09.748575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ba9d2-cac9-4bea-9e77-de2579a42b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:09.761618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ba9d2-cac9-4bea-9e77-de2579a42b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:09.763105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ba9d2-cac9-4bea-9e77-de2579a42b8a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-600ba9d2-cac9-4bea-9e77-de2579a42b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:09.783352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:09.784477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:09.785412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:09.785412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:09.785412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:09.785412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:09.785412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 629/1251] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:09.791573 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eca8a3-225d-4504-98be-19715fd7992c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:09.905923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eca8a3-225d-4504-98be-19715fd7992c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:09.944529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643200c-2413-4e0d-bb5e-8c63d8e58018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:09.945199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643200c-2413-4e0d-bb5e-8c63d8e58018 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:09.945508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643200c-2413-4e0d-bb5e-8c63d8e58018 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:09.945786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643200c-2413-4e0d-bb5e-8c63d8e58018 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:09.946575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643200c-2413-4e0d-bb5e-8c63d8e58018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:09.946940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643200c-2413-4e0d-bb5e-8c63d8e58018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:09.948665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643200c-2413-4e0d-bb5e-8c63d8e58018 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:09.962615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 623/1252] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:09.970956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ba9d2-cac9-4bea-9e77-de2579a42b8a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:10.081071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ba9d2-cac9-4bea-9e77-de2579a42b8a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:10.116186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c8d43-9076-4eaf-a3fd-900f770084ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:10.117012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c8d43-9076-4eaf-a3fd-900f770084ad None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:10.117819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c8d43-9076-4eaf-a3fd-900f770084ad None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:10.118125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c8d43-9076-4eaf-a3fd-900f770084ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:10.125402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c8d43-9076-4eaf-a3fd-900f770084ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:10.126871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c8d43-9076-4eaf-a3fd-900f770084ad None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-8a3c8d43-9076-4eaf-a3fd-900f770084ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:32:10.140900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:10.142236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:10.143376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 630/1253] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:10.148945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643200c-2413-4e0d-bb5e-8c63d8e58018 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:10.250411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643200c-2413-4e0d-bb5e-8c63d8e58018 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:10.287982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849406-9ee7-4837-83ca-1d8c3811a6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:10.288656 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849406-9ee7-4837-83ca-1d8c3811a6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:10.288941 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849406-9ee7-4837-83ca-1d8c3811a6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:10.289742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849406-9ee7-4837-83ca-1d8c3811a6f1 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:10.290630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849406-9ee7-4837-83ca-1d8c3811a6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:10.290932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849406-9ee7-4837-83ca-1d8c3811a6f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:10.292413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849406-9ee7-4837-83ca-1d8c3811a6f1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:10.312872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 624/1254] 10.222.0.75 () {56 vars in 1143 bytes} [Tue May 17 15:32:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:10.319513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c8d43-9076-4eaf-a3fd-900f770084ad None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:10.418106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c8d43-9076-4eaf-a3fd-900f770084ad None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:10.452851 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44f7f-5454-425f-9ecb-05c55c358701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:10.453499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44f7f-5454-425f-9ecb-05c55c358701 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:10.453776 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44f7f-5454-425f-9ecb-05c55c358701 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:10.454074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44f7f-5454-425f-9ecb-05c55c358701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:10.525430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44f7f-5454-425f-9ecb-05c55c358701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:10.526838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44f7f-5454-425f-9ecb-05c55c358701 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:10.631606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 631/1255] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:32:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 15:32:10.638045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849406-9ee7-4837-83ca-1d8c3811a6f1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:10.753874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849406-9ee7-4837-83ca-1d8c3811a6f1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:10.786701 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d2a66-43bc-4f25-8e51-62ed245d2d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:10.787416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d2a66-43bc-4f25-8e51-62ed245d2d24 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:10.787691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d2a66-43bc-4f25-8e51-62ed245d2d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:10.787959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d2a66-43bc-4f25-8e51-62ed245d2d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:10.799398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d2a66-43bc-4f25-8e51-62ed245d2d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:10.800886 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d2a66-43bc-4f25-8e51-62ed245d2d24 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a73d2a66-43bc-4f25-8e51-62ed245d2d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:10.819748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:10.820909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:10.821857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:10.821857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:10.821857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:10.821857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:10.821857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 625/1256] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 15:32:10.827166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44f7f-5454-425f-9ecb-05c55c358701 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:10.930087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44f7f-5454-425f-9ecb-05c55c358701 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:10.963786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8562f99-0d4a-46af-bf49-aea4ff7359d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:10.964460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8562f99-0d4a-46af-bf49-aea4ff7359d2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:10.964744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8562f99-0d4a-46af-bf49-aea4ff7359d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:10.965018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8562f99-0d4a-46af-bf49-aea4ff7359d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:10.965747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8562f99-0d4a-46af-bf49-aea4ff7359d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:10.966084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8562f99-0d4a-46af-bf49-aea4ff7359d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:10.967484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8562f99-0d4a-46af-bf49-aea4ff7359d2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:10.980519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 632/1257] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:32:10.986270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d2a66-43bc-4f25-8e51-62ed245d2d24 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:11.081298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d2a66-43bc-4f25-8e51-62ed245d2d24 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:11.115249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16b744-ce69-4fd2-a57d-7bfcfc5353b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:11.116038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16b744-ce69-4fd2-a57d-7bfcfc5353b1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:11.116376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16b744-ce69-4fd2-a57d-7bfcfc5353b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:11.116651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16b744-ce69-4fd2-a57d-7bfcfc5353b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:11.123478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16b744-ce69-4fd2-a57d-7bfcfc5353b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:11.124908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16b744-ce69-4fd2-a57d-7bfcfc5353b1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-fe16b744-ce69-4fd2-a57d-7bfcfc5353b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:32:11.138371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:11.139438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:11.140545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:32:11.140545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:32:11.140545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:32:11.140545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:32:11.140545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:32:11.140545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:32:11.140545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:11.140545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:11.140545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 626/1258] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:32:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:11.145610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8562f99-0d4a-46af-bf49-aea4ff7359d2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:11.244704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8562f99-0d4a-46af-bf49-aea4ff7359d2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:11.277630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743271c-d30b-4616-a78c-35f29dba091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:11.278319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743271c-d30b-4616-a78c-35f29dba091c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:11.278603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743271c-d30b-4616-a78c-35f29dba091c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:11.278876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743271c-d30b-4616-a78c-35f29dba091c None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:11.279651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743271c-d30b-4616-a78c-35f29dba091c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:11.279955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743271c-d30b-4616-a78c-35f29dba091c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:11.281376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743271c-d30b-4616-a78c-35f29dba091c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:11.292788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 633/1259] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:32:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:32:11.298824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16b744-ce69-4fd2-a57d-7bfcfc5353b1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:11.391704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16b744-ce69-4fd2-a57d-7bfcfc5353b1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:11.423759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c6e4a-bd99-49d4-a66e-13240869884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:11.424388 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c6e4a-bd99-49d4-a66e-13240869884c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:11.424668 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c6e4a-bd99-49d4-a66e-13240869884c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:11.424941 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c6e4a-bd99-49d4-a66e-13240869884c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:11.425755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c6e4a-bd99-49d4-a66e-13240869884c None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8614649160fb4bcca89b18ceeb6c0785) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:11.426093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c6e4a-bd99-49d4-a66e-13240869884c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:11.427498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c6e4a-bd99-49d4-a66e-13240869884c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:11.432613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 627/1260] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:32:11 2022] GET /identity/v3/role_assignments?user.id=8614649160fb4bcca89b18ceeb6c0785&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=cb77715547a14bae950f68513af00d30 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:13.611417 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758cb8f-a8ca-44aa-b1c6-1b8eace21056 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:13.611948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758cb8f-a8ca-44aa-b1c6-1b8eace21056 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:13.611948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758cb8f-a8ca-44aa-b1c6-1b8eace21056 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:13.613316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 634/1261] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:32:13.618382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2990d1-8216-4f67-9946-165181048710 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:13.618798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2990d1-8216-4f67-9946-165181048710 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:13.618934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2990d1-8216-4f67-9946-165181048710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:13.635512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bc2990d1-8216-4f67-9946-165181048710 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:32:13.636760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bc2990d1-8216-4f67-9946-165181048710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:32:13.707436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 628/1262] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:32:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:32:13.733879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758cb8f-a8ca-44aa-b1c6-1b8eace21056 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:13.826017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758cb8f-a8ca-44aa-b1c6-1b8eace21056 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:13.857184 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c2740-1f68-4b19-b2cc-df99156c3095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:13.857949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c2740-1f68-4b19-b2cc-df99156c3095 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:13.858253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c2740-1f68-4b19-b2cc-df99156c3095 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:13.858520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c2740-1f68-4b19-b2cc-df99156c3095 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:13.868037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c2740-1f68-4b19-b2cc-df99156c3095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-651c2740-1f68-4b19-b2cc-df99156c3095 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:32:13.875468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:13.876573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:13.882284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 635/1263] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:32:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:13.883730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2990d1-8216-4f67-9946-165181048710 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:13.973919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2990d1-8216-4f67-9946-165181048710 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:14.005063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedff18-9619-473f-b717-26454cf5679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:14.005705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedff18-9619-473f-b717-26454cf5679b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:14.005985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedff18-9619-473f-b717-26454cf5679b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:14.006288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedff18-9619-473f-b717-26454cf5679b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:14.007020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedff18-9619-473f-b717-26454cf5679b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:14.007323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedff18-9619-473f-b717-26454cf5679b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:14.009289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedff18-9619-473f-b717-26454cf5679b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:14.016778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 629/1264] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:32:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:14.022430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c2740-1f68-4b19-b2cc-df99156c3095 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:14.115484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c2740-1f68-4b19-b2cc-df99156c3095 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:14.147386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc718c6-6651-4974-ab82-804996cbeff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:14.148160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc718c6-6651-4974-ab82-804996cbeff0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:14.148440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc718c6-6651-4974-ab82-804996cbeff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:14.148716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc718c6-6651-4974-ab82-804996cbeff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:14.158743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc718c6-6651-4974-ab82-804996cbeff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:14.160171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc718c6-6651-4974-ab82-804996cbeff0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3cc718c6-6651-4974-ab82-804996cbeff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:14.176247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:14.177295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:14.178427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:14.178427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:14.178427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:14.178427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:14.178427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 636/1265] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:14.183638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedff18-9619-473f-b717-26454cf5679b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:14.277515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedff18-9619-473f-b717-26454cf5679b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:14.309574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de09a33-d963-4d31-a9c3-e3d17c7590fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:14.310251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09a33-d963-4d31-a9c3-e3d17c7590fa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:14.310534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09a33-d963-4d31-a9c3-e3d17c7590fa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:14.310809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09a33-d963-4d31-a9c3-e3d17c7590fa None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:14.311526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de09a33-d963-4d31-a9c3-e3d17c7590fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:14.311830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de09a33-d963-4d31-a9c3-e3d17c7590fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:14.313180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de09a33-d963-4d31-a9c3-e3d17c7590fa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:14.324242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 630/1266] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:14.329720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc718c6-6651-4974-ab82-804996cbeff0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:14.422642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc718c6-6651-4974-ab82-804996cbeff0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:14.459632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb8048-4045-48f7-a105-ad5c3552a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:14.460426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb8048-4045-48f7-a105-ad5c3552a1ac None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:14.460710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb8048-4045-48f7-a105-ad5c3552a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:14.460986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb8048-4045-48f7-a105-ad5c3552a1ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:14.468253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb8048-4045-48f7-a105-ad5c3552a1ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:14.469699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb8048-4045-48f7-a105-ad5c3552a1ac None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-36bb8048-4045-48f7-a105-ad5c3552a1ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:32:14.484246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:14.485367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:14.486591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:14.490183 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 637/1267] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:14.491147 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de09a33-d963-4d31-a9c3-e3d17c7590fa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:14.583322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de09a33-d963-4d31-a9c3-e3d17c7590fa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:14.615174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74c1df-8c6d-47ab-b406-8e7f69019afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:14.615827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c1df-8c6d-47ab-b406-8e7f69019afa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:14.616109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c1df-8c6d-47ab-b406-8e7f69019afa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:14.616380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c1df-8c6d-47ab-b406-8e7f69019afa None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:14.617772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74c1df-8c6d-47ab-b406-8e7f69019afa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:14.618106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74c1df-8c6d-47ab-b406-8e7f69019afa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:14.619518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74c1df-8c6d-47ab-b406-8e7f69019afa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:14.636383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 631/1268] 10.222.0.75 () {56 vars in 1143 bytes} [Tue May 17 15:32:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:14.642112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb8048-4045-48f7-a105-ad5c3552a1ac None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:14.746588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb8048-4045-48f7-a105-ad5c3552a1ac None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:14.778963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8057f-4984-4c44-9813-d5d1b7de061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:14.779752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8057f-4984-4c44-9813-d5d1b7de061e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:14.780034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8057f-4984-4c44-9813-d5d1b7de061e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:14.780305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8057f-4984-4c44-9813-d5d1b7de061e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:14.795427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8057f-4984-4c44-9813-d5d1b7de061e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:14.798114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8057f-4984-4c44-9813-d5d1b7de061e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-bbd8057f-4984-4c44-9813-d5d1b7de061e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:14.817404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:14.818455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:14.819438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:14.819438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:14.819438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:14.819438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:14.819438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 638/1269] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:14.825047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74c1df-8c6d-47ab-b406-8e7f69019afa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:14.916911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74c1df-8c6d-47ab-b406-8e7f69019afa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:14.947377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9769-b6ba-4e22-bcfe-9bcc40c1ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:14.948012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9769-b6ba-4e22-bcfe-9bcc40c1ca22 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:14.948288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9769-b6ba-4e22-bcfe-9bcc40c1ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:14.948555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9769-b6ba-4e22-bcfe-9bcc40c1ca22 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:14.949263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9769-b6ba-4e22-bcfe-9bcc40c1ca22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:14.949559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9769-b6ba-4e22-bcfe-9bcc40c1ca22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:14.950923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9769-b6ba-4e22-bcfe-9bcc40c1ca22 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:14.961782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 632/1270] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:32:14.967243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8057f-4984-4c44-9813-d5d1b7de061e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:15.060161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8057f-4984-4c44-9813-d5d1b7de061e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:15.093164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a53dcf-6638-478c-81c3-3455aec95d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:15.093940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a53dcf-6638-478c-81c3-3455aec95d3a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:15.094247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a53dcf-6638-478c-81c3-3455aec95d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:15.094519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a53dcf-6638-478c-81c3-3455aec95d3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:15.101103 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a53dcf-6638-478c-81c3-3455aec95d3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:15.102593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a53dcf-6638-478c-81c3-3455aec95d3a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-b9a53dcf-6638-478c-81c3-3455aec95d3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:32:15.116282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:15.117303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:15.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:32:15.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:32:15.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:32:15.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:32:15.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:32:15.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:32:15.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:15.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:15.118477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 639/1271] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:32:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:15.123181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9769-b6ba-4e22-bcfe-9bcc40c1ca22 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:15.217021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9769-b6ba-4e22-bcfe-9bcc40c1ca22 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:15.248054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404a374-056c-47d7-826c-20feff1f95de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:15.248705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a374-056c-47d7-826c-20feff1f95de None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:15.248986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a374-056c-47d7-826c-20feff1f95de None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:15.249258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a374-056c-47d7-826c-20feff1f95de None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:15.250123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404a374-056c-47d7-826c-20feff1f95de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:15.250431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404a374-056c-47d7-826c-20feff1f95de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:15.251854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404a374-056c-47d7-826c-20feff1f95de None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:15.263674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 633/1272] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:32:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:15.269526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a53dcf-6638-478c-81c3-3455aec95d3a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:15.361271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a53dcf-6638-478c-81c3-3455aec95d3a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:15.392495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4466288-5012-4e9b-9482-0a7467e66d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:15.393356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4466288-5012-4e9b-9482-0a7467e66d8c None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:15.393633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4466288-5012-4e9b-9482-0a7467e66d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:15.393903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4466288-5012-4e9b-9482-0a7467e66d8c None admin] PATH_INFO: `/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8614649160fb4bcca89b18ceeb6c0785/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:15.395826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4466288-5012-4e9b-9482-0a7467e66d8c None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2781d8d664de3a757901c184962d4, user_id=8614649160fb4bcca89b18ceeb6c0785, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:15.397241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4466288-5012-4e9b-9482-0a7467e66d8c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:15.409815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 640/1273] 10.222.0.75 () {58 vars in 1439 bytes} [Tue May 17 15:32:15 2022] PUT /identity/v3/projects/cfd2781d8d664de3a757901c184962d4/users/8614649160fb4bcca89b18ceeb6c0785/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:32:17.574400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc42542-0142-40d8-a3a4-39e611f6a3d6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:17.574914 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc42542-0142-40d8-a3a4-39e611f6a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:17.574914 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc42542-0142-40d8-a3a4-39e611f6a3d6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:17.576206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 634/1274] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:32:17.581318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cdcf7-7710-4621-992f-ab885d0555a4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:17.581692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cdcf7-7710-4621-992f-ab885d0555a4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:17.581864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cdcf7-7710-4621-992f-ab885d0555a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:17.598226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e38cdcf7-7710-4621-992f-ab885d0555a4 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:32:17.599387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e38cdcf7-7710-4621-992f-ab885d0555a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:32:17.667078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 641/1275] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:32:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:32:17.691669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc42542-0142-40d8-a3a4-39e611f6a3d6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:17.786052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc42542-0142-40d8-a3a4-39e611f6a3d6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:17.818322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2bce3-953d-4f6e-8266-0af19fe9a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:17.819086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2bce3-953d-4f6e-8266-0af19fe9a345 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:17.819365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2bce3-953d-4f6e-8266-0af19fe9a345 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:17.819636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2bce3-953d-4f6e-8266-0af19fe9a345 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:17.829186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2bce3-953d-4f6e-8266-0af19fe9a345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c2e2bce3-953d-4f6e-8266-0af19fe9a345 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 15:32:17.837489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:17.838613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:17.839529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 635/1276] 10.222.0.75 () {56 vars in 1096 bytes} [Tue May 17 15:32:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:17.844725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cdcf7-7710-4621-992f-ab885d0555a4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:17.935827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cdcf7-7710-4621-992f-ab885d0555a4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:17.966908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d8149-c0e0-4b53-a52a-e1f1d383c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:17.967549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d8149-c0e0-4b53-a52a-e1f1d383c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:17.967825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d8149-c0e0-4b53-a52a-e1f1d383c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:17.968092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d8149-c0e0-4b53-a52a-e1f1d383c3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:17.968817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d8149-c0e0-4b53-a52a-e1f1d383c3a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:17.969114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d8149-c0e0-4b53-a52a-e1f1d383c3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:17.970741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d8149-c0e0-4b53-a52a-e1f1d383c3a5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:17.978698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 642/1277] 10.222.0.75 () {56 vars in 1099 bytes} [Tue May 17 15:32:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:17.984261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2bce3-953d-4f6e-8266-0af19fe9a345 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:18.076988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2bce3-953d-4f6e-8266-0af19fe9a345 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:18.108355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29112ced-9033-4db7-ac02-e23d9a1d7ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:18.109122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29112ced-9033-4db7-ac02-e23d9a1d7ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:18.109407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29112ced-9033-4db7-ac02-e23d9a1d7ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:18.109681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29112ced-9033-4db7-ac02-e23d9a1d7ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:18.119550 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29112ced-9033-4db7-ac02-e23d9a1d7ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:18.120986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29112ced-9033-4db7-ac02-e23d9a1d7ef8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-29112ced-9033-4db7-ac02-e23d9a1d7ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:18.137556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:18.138627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:18.139770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:18.139770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:18.139770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:18.139770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:18.139770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 636/1278] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:18.144554 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d8149-c0e0-4b53-a52a-e1f1d383c3a5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:18.237523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d8149-c0e0-4b53-a52a-e1f1d383c3a5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:18.268310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60df5-8b25-4945-aef3-b90551a7c27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:18.268957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60df5-8b25-4945-aef3-b90551a7c27a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:18.269232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60df5-8b25-4945-aef3-b90551a7c27a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:18.269501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60df5-8b25-4945-aef3-b90551a7c27a None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:18.270227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60df5-8b25-4945-aef3-b90551a7c27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:18.270523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60df5-8b25-4945-aef3-b90551a7c27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:18.271866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60df5-8b25-4945-aef3-b90551a7c27a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:18.283409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 643/1279] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:18.288893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29112ced-9033-4db7-ac02-e23d9a1d7ef8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:18.380292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29112ced-9033-4db7-ac02-e23d9a1d7ef8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:18.411528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6573de0-71c9-4acc-aaef-960f3e675cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:18.412295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6573de0-71c9-4acc-aaef-960f3e675cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:18.412575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6573de0-71c9-4acc-aaef-960f3e675cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:18.412847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6573de0-71c9-4acc-aaef-960f3e675cf5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:18.422761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6573de0-71c9-4acc-aaef-960f3e675cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:18.424192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6573de0-71c9-4acc-aaef-960f3e675cf5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d6573de0-71c9-4acc-aaef-960f3e675cf5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 15:32:18.438775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:18.439879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:18.441027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 637/1280] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:18.446866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60df5-8b25-4945-aef3-b90551a7c27a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:18.537982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60df5-8b25-4945-aef3-b90551a7c27a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:18.569383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d87f6-bac4-411b-9197-5604e225e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:18.570618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d87f6-bac4-411b-9197-5604e225e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:18.570897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d87f6-bac4-411b-9197-5604e225e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:18.571166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d87f6-bac4-411b-9197-5604e225e2d7 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:18.571980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d87f6-bac4-411b-9197-5604e225e2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:18.572280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d87f6-bac4-411b-9197-5604e225e2d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:18.573689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d87f6-bac4-411b-9197-5604e225e2d7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:18.589539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 644/1281] 10.222.0.75 () {56 vars in 1143 bytes} [Tue May 17 15:32:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:32:18.595368 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6573de0-71c9-4acc-aaef-960f3e675cf5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:18.695915 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6573de0-71c9-4acc-aaef-960f3e675cf5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:18.730635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c6c35-b4fd-4d28-a2a9-7265b6a067ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:18.731282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c6c35-b4fd-4d28-a2a9-7265b6a067ba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:18.731566 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c6c35-b4fd-4d28-a2a9-7265b6a067ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:18.731845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c6c35-b4fd-4d28-a2a9-7265b6a067ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:18.797572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c6c35-b4fd-4d28-a2a9-7265b6a067ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:18.799033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c6c35-b4fd-4d28-a2a9-7265b6a067ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:18.891858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 638/1282] 10.222.0.75 () {58 vars in 1282 bytes} [Tue May 17 15:32:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 15:32:18.897612 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d87f6-bac4-411b-9197-5604e225e2d7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:18.990617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d87f6-bac4-411b-9197-5604e225e2d7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:19.022377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce495590-7eaa-4d2b-be1a-5ade2bfa795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:19.023152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce495590-7eaa-4d2b-be1a-5ade2bfa795b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:19.023435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce495590-7eaa-4d2b-be1a-5ade2bfa795b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:19.023711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce495590-7eaa-4d2b-be1a-5ade2bfa795b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:19.033143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce495590-7eaa-4d2b-be1a-5ade2bfa795b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:19.034619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce495590-7eaa-4d2b-be1a-5ade2bfa795b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ce495590-7eaa-4d2b-be1a-5ade2bfa795b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 15:32:19.052016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:19.053077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:19.054313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 15:32:19.054313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 15:32:19.054313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 15:32:19.054313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:19.054313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 645/1283] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:19.059352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c6c35-b4fd-4d28-a2a9-7265b6a067ba None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:19.154645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c6c35-b4fd-4d28-a2a9-7265b6a067ba None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:19.186466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe09d7-f01c-42ea-ac6a-e78776248a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:19.187114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe09d7-f01c-42ea-ac6a-e78776248a4d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:19.187398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe09d7-f01c-42ea-ac6a-e78776248a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:19.187674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe09d7-f01c-42ea-ac6a-e78776248a4d None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:19.188391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe09d7-f01c-42ea-ac6a-e78776248a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:19.188698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe09d7-f01c-42ea-ac6a-e78776248a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:19.190087 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe09d7-f01c-42ea-ac6a-e78776248a4d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:19.200629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 639/1284] 10.222.0.75 () {56 vars in 1109 bytes} [Tue May 17 15:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:19.206268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce495590-7eaa-4d2b-be1a-5ade2bfa795b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:19.299956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce495590-7eaa-4d2b-be1a-5ade2bfa795b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:19.330422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3b914-c708-4687-b1dc-2393cdf532f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:19.331187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b914-c708-4687-b1dc-2393cdf532f6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:19.331462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b914-c708-4687-b1dc-2393cdf532f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:19.331730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b914-c708-4687-b1dc-2393cdf532f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:19.338442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3b914-c708-4687-b1dc-2393cdf532f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:19.339863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3b914-c708-4687-b1dc-2393cdf532f6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-71b3b914-c708-4687-b1dc-2393cdf532f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 15:32:19.353671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:19.354742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:19.355820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 15:32:19.355820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 15:32:19.355820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 15:32:19.355820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 15:32:19.355820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 15:32:19.355820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 15:32:19.355820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 15:32:19.355820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: ERROR keystone.server.flask.application May 17 15:32:19.355820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 646/1285] 10.222.0.75 () {56 vars in 1111 bytes} [Tue May 17 15:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:19.360523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe09d7-f01c-42ea-ac6a-e78776248a4d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:19.454300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe09d7-f01c-42ea-ac6a-e78776248a4d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:19.486408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab3449-3de8-40a6-9335-f9c87e47c6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:19.487055 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab3449-3de8-40a6-9335-f9c87e47c6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:19.487333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab3449-3de8-40a6-9335-f9c87e47c6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:19.487605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab3449-3de8-40a6-9335-f9c87e47c6a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:19.488381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab3449-3de8-40a6-9335-f9c87e47c6a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:19.488685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab3449-3de8-40a6-9335-f9c87e47c6a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:19.490115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab3449-3de8-40a6-9335-f9c87e47c6a8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:19.501302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 640/1286] 10.222.0.75 () {56 vars in 1148 bytes} [Tue May 17 15:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:19.508078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3b914-c708-4687-b1dc-2393cdf532f6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:19.602180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3b914-c708-4687-b1dc-2393cdf532f6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:19.633225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae5314-7ec5-493f-b8dc-2ed25463ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:19.633942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae5314-7ec5-493f-b8dc-2ed25463ec7f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:19.634313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae5314-7ec5-493f-b8dc-2ed25463ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:19.634552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae5314-7ec5-493f-b8dc-2ed25463ec7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:19.635539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae5314-7ec5-493f-b8dc-2ed25463ec7f None admin] RBAC: Adding query filter params (role.id=cb77715547a14bae950f68513af00d30, scope.project.id=cfd2781d8d664de3a757901c184962d4, user.id=8614649160fb4bcca89b18ceeb6c0785) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:19.635765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae5314-7ec5-493f-b8dc-2ed25463ec7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:19.637410 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae5314-7ec5-493f-b8dc-2ed25463ec7f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:19.644291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 647/1287] 10.222.0.75 () {56 vars in 1374 bytes} [Tue May 17 15:32:19 2022] GET /identity/v3/role_assignments?user.id=8614649160fb4bcca89b18ceeb6c0785&scope.project.id=cfd2781d8d664de3a757901c184962d4&role.id=cb77715547a14bae950f68513af00d30 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:21.845803 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3302-c0da-4d57-8c4e-ac6d7a3119a9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:21.846358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3302-c0da-4d57-8c4e-ac6d7a3119a9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:21.846358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3302-c0da-4d57-8c4e-ac6d7a3119a9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:21.847737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 641/1288] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:32:21.853749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61889272-26ac-4c05-b582-02c70a07b9f6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:21.854196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61889272-26ac-4c05-b582-02c70a07b9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:21.854331 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61889272-26ac-4c05-b582-02c70a07b9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:21.872011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-61889272-26ac-4c05-b582-02c70a07b9f6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:32:21.873177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-61889272-26ac-4c05-b582-02c70a07b9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:32:21.935788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 648/1289] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:32:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:32:21.957354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e3302-c0da-4d57-8c4e-ac6d7a3119a9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:22.051288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e3302-c0da-4d57-8c4e-ac6d7a3119a9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:22.082743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332546f0-1947-488a-a356-ccdbee596810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:22.083514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332546f0-1947-488a-a356-ccdbee596810 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:22.083792 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332546f0-1947-488a-a356-ccdbee596810 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:22.084065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332546f0-1947-488a-a356-ccdbee596810 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:22.084708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332546f0-1947-488a-a356-ccdbee596810 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:22.086112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332546f0-1947-488a-a356-ccdbee596810 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-332546f0-1947-488a-a356-ccdbee596810 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:22.097751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:22.099100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:22.100241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 642/1290] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:32:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:22.105207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61889272-26ac-4c05-b582-02c70a07b9f6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:22.200116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61889272-26ac-4c05-b582-02c70a07b9f6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:22.231649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d42c1-e69f-4f88-906c-f634bf5230e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:22.232321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d42c1-e69f-4f88-906c-f634bf5230e8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:22.232603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d42c1-e69f-4f88-906c-f634bf5230e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:22.232938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d42c1-e69f-4f88-906c-f634bf5230e8 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:22.233578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d42c1-e69f-4f88-906c-f634bf5230e8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:22.233881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d42c1-e69f-4f88-906c-f634bf5230e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:22.235292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d42c1-e69f-4f88-906c-f634bf5230e8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:22.240073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 649/1291] 10.222.0.75 () {56 vars in 1116 bytes} [Tue May 17 15:32:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:22.246453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332546f0-1947-488a-a356-ccdbee596810 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:22.338169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332546f0-1947-488a-a356-ccdbee596810 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:22.368911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fc661-edad-4ab1-a28d-00090ceb854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:22.369542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fc661-edad-4ab1-a28d-00090ceb854f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:22.369818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fc661-edad-4ab1-a28d-00090ceb854f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:22.370117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fc661-edad-4ab1-a28d-00090ceb854f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:22.370814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fc661-edad-4ab1-a28d-00090ceb854f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:22.371114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fc661-edad-4ab1-a28d-00090ceb854f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:22.372447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fc661-edad-4ab1-a28d-00090ceb854f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:22.376558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 643/1292] 10.222.0.75 () {56 vars in 1116 bytes} [Tue May 17 15:32:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:32:24.572617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9c2d9-c6af-4c88-aaff-0ce3b9cb0a3b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:24.573131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9c2d9-c6af-4c88-aaff-0ce3b9cb0a3b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:24.573131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9c2d9-c6af-4c88-aaff-0ce3b9cb0a3b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:24.574470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 650/1293] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:32:24.579628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122776b-d42f-443d-993b-acb31f5d27da None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:24.579987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122776b-d42f-443d-993b-acb31f5d27da None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:24.580190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122776b-d42f-443d-993b-acb31f5d27da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:24.597117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1122776b-d42f-443d-993b-acb31f5d27da None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:32:24.598332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1122776b-d42f-443d-993b-acb31f5d27da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:32:24.665807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 644/1294] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:32:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:32:24.691697 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9c2d9-c6af-4c88-aaff-0ce3b9cb0a3b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:24.791723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9c2d9-c6af-4c88-aaff-0ce3b9cb0a3b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:24.822844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b149d28-19df-4e76-aab6-f151e2a44232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:24.823431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b149d28-19df-4e76-aab6-f151e2a44232 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:24.823712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b149d28-19df-4e76-aab6-f151e2a44232 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:24.824012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b149d28-19df-4e76-aab6-f151e2a44232 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:24.824702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b149d28-19df-4e76-aab6-f151e2a44232 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:24.826077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b149d28-19df-4e76-aab6-f151e2a44232 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:24.838568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 651/1295] 10.222.0.75 () {60 vars in 1141 bytes} [Tue May 17 15:32:24 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:32:27.045394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72567853-b021-41cb-b106-bf9fff4bd42c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:27.045964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72567853-b021-41cb-b106-bf9fff4bd42c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:27.045964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72567853-b021-41cb-b106-bf9fff4bd42c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:27.047342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 645/1296] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:32:27.052433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a2650-0425-4f1f-95cc-33e5fd01cf82 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:27.052853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a2650-0425-4f1f-95cc-33e5fd01cf82 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:27.052984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a2650-0425-4f1f-95cc-33e5fd01cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:27.069126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-402a2650-0425-4f1f-95cc-33e5fd01cf82 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:32:27.070808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-402a2650-0425-4f1f-95cc-33e5fd01cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:32:27.138457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 652/1297] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:32:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:32:27.160796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72567853-b021-41cb-b106-bf9fff4bd42c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:27.254972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72567853-b021-41cb-b106-bf9fff4bd42c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:27.287571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55665a1f-bc8f-400f-948e-c65f551c0e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:27.288361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55665a1f-bc8f-400f-948e-c65f551c0e29 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:27.288638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55665a1f-bc8f-400f-948e-c65f551c0e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:27.288907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55665a1f-bc8f-400f-948e-c65f551c0e29 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:27.289545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55665a1f-bc8f-400f-948e-c65f551c0e29 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:27.290920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55665a1f-bc8f-400f-948e-c65f551c0e29 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-55665a1f-bc8f-400f-948e-c65f551c0e29 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:27.302181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:27.303335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:27.304327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 646/1298] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:32:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:27.309393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a2650-0425-4f1f-95cc-33e5fd01cf82 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:27.401593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a2650-0425-4f1f-95cc-33e5fd01cf82 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:27.433019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bab1a-95d5-41c4-b222-3bf7ffec2021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:27.433666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bab1a-95d5-41c4-b222-3bf7ffec2021 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:27.433948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bab1a-95d5-41c4-b222-3bf7ffec2021 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:27.434255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bab1a-95d5-41c4-b222-3bf7ffec2021 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:27.434952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bab1a-95d5-41c4-b222-3bf7ffec2021 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:27.435260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bab1a-95d5-41c4-b222-3bf7ffec2021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:27.436621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bab1a-95d5-41c4-b222-3bf7ffec2021 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:27.441475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 653/1299] 10.222.0.75 () {56 vars in 1116 bytes} [Tue May 17 15:32:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:27.447719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55665a1f-bc8f-400f-948e-c65f551c0e29 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:27.538267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55665a1f-bc8f-400f-948e-c65f551c0e29 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:27.570246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efd930-8e8e-4f9b-bc02-a4ba0c71f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:27.570842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efd930-8e8e-4f9b-bc02-a4ba0c71f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:27.571120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efd930-8e8e-4f9b-bc02-a4ba0c71f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:27.571389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efd930-8e8e-4f9b-bc02-a4ba0c71f1a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:27.572157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efd930-8e8e-4f9b-bc02-a4ba0c71f1a1 None admin] RBAC: Adding query filter params (interface=public, service_id=4a07287899a5443f974bbdc76c535eb1, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:27.572467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efd930-8e8e-4f9b-bc02-a4ba0c71f1a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:27.573793 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efd930-8e8e-4f9b-bc02-a4ba0c71f1a1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:27.578487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 647/1300] 10.222.0.75 () {56 vars in 1251 bytes} [Tue May 17 15:32:27 2022] GET /identity/v3/endpoints?service_id=4a07287899a5443f974bbdc76c535eb1&interface=public®ion_id=RegionOne => generated 194 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:27.583874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bab1a-95d5-41c4-b222-3bf7ffec2021 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:27.687584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bab1a-95d5-41c4-b222-3bf7ffec2021 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:27.721385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbf749-f570-4109-8e5c-c9174000c578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:27.722053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbf749-f570-4109-8e5c-c9174000c578 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:27.722332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbf749-f570-4109-8e5c-c9174000c578 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:27.722602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbf749-f570-4109-8e5c-c9174000c578 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:27.723264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbf749-f570-4109-8e5c-c9174000c578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:27.724618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbf749-f570-4109-8e5c-c9174000c578 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:27.731105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 654/1301] 10.222.0.75 () {56 vars in 1087 bytes} [Tue May 17 15:32:27 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:32:29.883300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff929cc3-cf78-49b5-8f48-282a7393525c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:29.883864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff929cc3-cf78-49b5-8f48-282a7393525c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:29.883864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff929cc3-cf78-49b5-8f48-282a7393525c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:29.885152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 648/1302] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:32:29.890669 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf518-8cfa-45f6-870a-169d66ab349f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:29.891077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf518-8cfa-45f6-870a-169d66ab349f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:29.891218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf518-8cfa-45f6-870a-169d66ab349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:29.908156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-facdf518-8cfa-45f6-870a-169d66ab349f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:32:29.909334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-facdf518-8cfa-45f6-870a-169d66ab349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:32:29.971565 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 655/1303] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:32:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 15:32:29.993926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff929cc3-cf78-49b5-8f48-282a7393525c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:30.087921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff929cc3-cf78-49b5-8f48-282a7393525c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:30.120200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa2d7-fc2f-4941-91b2-9739a89e3d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:30.120978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa2d7-fc2f-4941-91b2-9739a89e3d49 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:30.121261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa2d7-fc2f-4941-91b2-9739a89e3d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:30.121537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa2d7-fc2f-4941-91b2-9739a89e3d49 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:30.122211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa2d7-fc2f-4941-91b2-9739a89e3d49 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:30.123574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa2d7-fc2f-4941-91b2-9739a89e3d49 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-358fa2d7-fc2f-4941-91b2-9739a89e3d49 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 15:32:30.135001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 15:32:30.136172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: ERROR keystone.server.flask.application May 17 15:32:30.137233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 649/1304] 10.222.0.75 () {56 vars in 1117 bytes} [Tue May 17 15:32:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 15:32:30.142108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf518-8cfa-45f6-870a-169d66ab349f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:30.239939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf518-8cfa-45f6-870a-169d66ab349f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:30.272794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf4f05-5103-4177-b952-81798079b6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:30.273450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf4f05-5103-4177-b952-81798079b6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:30.273733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf4f05-5103-4177-b952-81798079b6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:30.274034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf4f05-5103-4177-b952-81798079b6a5 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:30.274730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf4f05-5103-4177-b952-81798079b6a5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:32:30.275035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf4f05-5103-4177-b952-81798079b6a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:30.276401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf4f05-5103-4177-b952-81798079b6a5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:30.281292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 656/1305] 10.222.0.75 () {56 vars in 1116 bytes} [Tue May 17 15:32:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:32:30.287038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa2d7-fc2f-4941-91b2-9739a89e3d49 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:32:30.380415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa2d7-fc2f-4941-91b2-9739a89e3d49 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:32:30.411589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2591-7b07-4365-8e21-cbd0be6fc859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:32:30.412159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2591-7b07-4365-8e21-cbd0be6fc859 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:32:30.412437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2591-7b07-4365-8e21-cbd0be6fc859 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:32:30.412707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2591-7b07-4365-8e21-cbd0be6fc859 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:32:30.414025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b2591-7b07-4365-8e21-cbd0be6fc859 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:32:30.415364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b2591-7b07-4365-8e21-cbd0be6fc859 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:32:30.432450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 650/1306] 10.222.0.75 () {60 vars in 1144 bytes} [Tue May 17 15:32:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:33:34.010739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f321b-38e7-4970-a46f-33d9b46357f0 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:34.011198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f321b-38e7-4970-a46f-33d9b46357f0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:34.011423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f321b-38e7-4970-a46f-33d9b46357f0 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:34.017720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df873edb-4ba3-41cd-bc98-20f15acd893c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:34.018142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df873edb-4ba3-41cd-bc98-20f15acd893c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:34.018427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df873edb-4ba3-41cd-bc98-20f15acd893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:34.021844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 657/1307] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:33:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:34.183687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-df873edb-4ba3-41cd-bc98-20f15acd893c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:34.186743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-df873edb-4ba3-41cd-bc98-20f15acd893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:34.315856 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 651/1308] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:33:34.365992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee265819-6228-481c-986b-57a7c2cc6944 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:34.366702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee265819-6228-481c-986b-57a7c2cc6944 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:34.367191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee265819-6228-481c-986b-57a7c2cc6944 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:34.369235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 658/1309] 10.222.0.75 () {54 vars in 964 bytes} [Tue May 17 15:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:34.374581 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db0f2-8b6f-4375-aa44-8fd18fc919fb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:34.374871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db0f2-8b6f-4375-aa44-8fd18fc919fb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:34.375142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db0f2-8b6f-4375-aa44-8fd18fc919fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:34.452764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-564db0f2-8b6f-4375-aa44-8fd18fc919fb None None] MFA Rules not processed for user `03e9f522282644e2aad2eefba7509f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:34.453976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-564db0f2-8b6f-4375-aa44-8fd18fc919fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:34.553243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 652/1310] 10.222.0.75 () {58 vars in 1061 bytes} [Tue May 17 15:33:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:33:34.554048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee265819-6228-481c-986b-57a7c2cc6944 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:33:34.556057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ee265819-6228-481c-986b-57a7c2cc6944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:34.675335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee265819-6228-481c-986b-57a7c2cc6944 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:33:34.755741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba966d0-9b80-474c-b610-6fa1e1064a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:33:34.756630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba966d0-9b80-474c-b610-6fa1e1064a16 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:34.757057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba966d0-9b80-474c-b610-6fa1e1064a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:34.757475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba966d0-9b80-474c-b610-6fa1e1064a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:34.759276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4ba966d0-9b80-474c-b610-6fa1e1064a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:34.877112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba966d0-9b80-474c-b610-6fa1e1064a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:33:34.878866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba966d0-9b80-474c-b610-6fa1e1064a16 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:33:34.904828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 659/1311] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:33:37.486636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2b06-3a47-4a5f-ab96-916245be66ca None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:37.487331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2b06-3a47-4a5f-ab96-916245be66ca None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:37.487331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2b06-3a47-4a5f-ab96-916245be66ca None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:37.491194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 653/1312] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:37.498691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dd5eb-18a5-492c-911c-3f12e0058fc2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:37.499179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dd5eb-18a5-492c-911c-3f12e0058fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:37.499285 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dd5eb-18a5-492c-911c-3f12e0058fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:37.586327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c06dd5eb-18a5-492c-911c-3f12e0058fc2 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:37.587537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c06dd5eb-18a5-492c-911c-3f12e0058fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:37.685536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 660/1313] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:33:37.724822 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e2b06-3a47-4a5f-ab96-916245be66ca None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:33:37.726591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a69e2b06-3a47-4a5f-ab96-916245be66ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:37.831616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e2b06-3a47-4a5f-ab96-916245be66ca None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:33:37.902019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be844a55-e394-46fe-9c19-38e254e7be81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:33:37.902688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be844a55-e394-46fe-9c19-38e254e7be81 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:37.902963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be844a55-e394-46fe-9c19-38e254e7be81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:37.903229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be844a55-e394-46fe-9c19-38e254e7be81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:37.904845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-be844a55-e394-46fe-9c19-38e254e7be81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:38.009456 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be844a55-e394-46fe-9c19-38e254e7be81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:33:38.011110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be844a55-e394-46fe-9c19-38e254e7be81 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:33:38.030778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 654/1314] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:33:40.558126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff235-bad6-437e-8d6b-1d6a07c19ce1 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:40.558704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff235-bad6-437e-8d6b-1d6a07c19ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:40.558704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff235-bad6-437e-8d6b-1d6a07c19ce1 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:40.560023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 661/1315] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:40.565269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecad041-2a82-4aaf-b566-2647efac4445 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:40.565688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecad041-2a82-4aaf-b566-2647efac4445 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:40.565886 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecad041-2a82-4aaf-b566-2647efac4445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:40.627242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aecad041-2a82-4aaf-b566-2647efac4445 None None] MFA Rules not processed for user `d63543b997cd4d44b3f069a642b26186`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:40.628457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aecad041-2a82-4aaf-b566-2647efac4445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:40.718265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 655/1316] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:33:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:33:40.758028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff235-bad6-437e-8d6b-1d6a07c19ce1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:33:40.759615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3c3ff235-bad6-437e-8d6b-1d6a07c19ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:40.857594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff235-bad6-437e-8d6b-1d6a07c19ce1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:33:40.928039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3bb3f-c6b1-410e-92e3-67e28d1ffc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:33:40.928673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3bb3f-c6b1-410e-92e3-67e28d1ffc9b service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:40.928955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3bb3f-c6b1-410e-92e3-67e28d1ffc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:40.929229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3bb3f-c6b1-410e-92e3-67e28d1ffc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:40.930909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2da3bb3f-c6b1-410e-92e3-67e28d1ffc9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:41.035979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3bb3f-c6b1-410e-92e3-67e28d1ffc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:33:41.037417 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3bb3f-c6b1-410e-92e3-67e28d1ffc9b service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:33:41.059486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 662/1317] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:33:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:33:43.884720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27ab8-49fa-446c-a0a1-d9c36f31280a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:43.885249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27ab8-49fa-446c-a0a1-d9c36f31280a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:43.885249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27ab8-49fa-446c-a0a1-d9c36f31280a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:43.886685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 656/1318] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:43.891969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b685c-cd93-45c1-a85c-4887d41d25f0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:43.892412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b685c-cd93-45c1-a85c-4887d41d25f0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:43.892519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b685c-cd93-45c1-a85c-4887d41d25f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:43.954305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-973b685c-cd93-45c1-a85c-4887d41d25f0 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:43.955477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-973b685c-cd93-45c1-a85c-4887d41d25f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:44.046487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 663/1319] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:33:44.084763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca27ab8-49fa-446c-a0a1-d9c36f31280a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:33:44.086334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2ca27ab8-49fa-446c-a0a1-d9c36f31280a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:44.185338 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca27ab8-49fa-446c-a0a1-d9c36f31280a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:33:44.254893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1198-db71-4f4f-a080-144ab1376861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:33:44.255538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1198-db71-4f4f-a080-144ab1376861 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:44.255821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1198-db71-4f4f-a080-144ab1376861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:44.256098 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1198-db71-4f4f-a080-144ab1376861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:44.257724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1d4a1198-db71-4f4f-a080-144ab1376861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:44.366445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a1198-db71-4f4f-a080-144ab1376861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:33:44.367875 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a1198-db71-4f4f-a080-144ab1376861 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:33:44.386377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 657/1320] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:33:47.252096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e2c13-2dfd-4e36-8ee1-4497385a730a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:47.252638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e2c13-2dfd-4e36-8ee1-4497385a730a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:47.252638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e2c13-2dfd-4e36-8ee1-4497385a730a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:47.254570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 664/1321] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:47.259732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090461b-1ea2-4a86-8562-9f5dd6adf77a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:47.260117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090461b-1ea2-4a86-8562-9f5dd6adf77a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:47.260298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090461b-1ea2-4a86-8562-9f5dd6adf77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:47.322186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0090461b-1ea2-4a86-8562-9f5dd6adf77a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:47.323389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0090461b-1ea2-4a86-8562-9f5dd6adf77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:47.415425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 658/1322] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:33:47.451330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e2c13-2dfd-4e36-8ee1-4497385a730a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:33:47.452858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dd8e2c13-2dfd-4e36-8ee1-4497385a730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:47.562454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e2c13-2dfd-4e36-8ee1-4497385a730a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:33:47.640770 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8abe6-19f5-4297-90f0-5b46d79db1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:33:47.641429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8abe6-19f5-4297-90f0-5b46d79db1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:47.641741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8abe6-19f5-4297-90f0-5b46d79db1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:47.642088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8abe6-19f5-4297-90f0-5b46d79db1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:47.643783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e2b8abe6-19f5-4297-90f0-5b46d79db1c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:47.751524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8abe6-19f5-4297-90f0-5b46d79db1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:33:47.752896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8abe6-19f5-4297-90f0-5b46d79db1c4 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:33:47.772761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 665/1323] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:33:50.050020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349caa59-e942-484e-b50d-962759d2b0d8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:50.051062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349caa59-e942-484e-b50d-962759d2b0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:50.051062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349caa59-e942-484e-b50d-962759d2b0d8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:50.052451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 659/1324] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:50.057585 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb76f-9ec6-4889-b0c6-c6da8cf77e5a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:50.057968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb76f-9ec6-4889-b0c6-c6da8cf77e5a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:50.058181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb76f-9ec6-4889-b0c6-c6da8cf77e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:50.120660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-94dcb76f-9ec6-4889-b0c6-c6da8cf77e5a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:50.122021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-94dcb76f-9ec6-4889-b0c6-c6da8cf77e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:50.216174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 666/1325] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:33:50.268060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80738e-3fd6-4caa-809d-260030d5f2ce None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:50.268463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80738e-3fd6-4caa-809d-260030d5f2ce None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:50.268747 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80738e-3fd6-4caa-809d-260030d5f2ce None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:50.270150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 660/1326] 10.222.0.75 () {54 vars in 964 bytes} [Tue May 17 15:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:50.276159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f978bfd-e432-41fb-be71-c1fa99e3e6e8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:50.276448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f978bfd-e432-41fb-be71-c1fa99e3e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:50.276726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f978bfd-e432-41fb-be71-c1fa99e3e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:50.348372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5f978bfd-e432-41fb-be71-c1fa99e3e6e8 None None] MFA Rules not processed for user `03e9f522282644e2aad2eefba7509f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:50.349466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5f978bfd-e432-41fb-be71-c1fa99e3e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:50.421580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 667/1327] 10.222.0.75 () {58 vars in 1061 bytes} [Tue May 17 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:33:50.431212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80738e-3fd6-4caa-809d-260030d5f2ce None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:33:50.432728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9e80738e-3fd6-4caa-809d-260030d5f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:50.528680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80738e-3fd6-4caa-809d-260030d5f2ce None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:33:50.598666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa423bd2-c239-40ab-bfe0-8616d2825f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:33:50.599234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423bd2-c239-40ab-bfe0-8616d2825f84 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:50.599511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423bd2-c239-40ab-bfe0-8616d2825f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:50.599780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423bd2-c239-40ab-bfe0-8616d2825f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:50.601407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fa423bd2-c239-40ab-bfe0-8616d2825f84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:50.709859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa423bd2-c239-40ab-bfe0-8616d2825f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:33:50.711330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa423bd2-c239-40ab-bfe0-8616d2825f84 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:33:50.729833 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 661/1328] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:33:53.267392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fd8a3-59a6-4ef8-ad85-360eaa5dab00 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:53.267914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fd8a3-59a6-4ef8-ad85-360eaa5dab00 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:53.267914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fd8a3-59a6-4ef8-ad85-360eaa5dab00 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:53.269859 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 668/1329] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:53.275137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853b469-9e5e-4a31-9cef-2b6cd94f7379 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:53.275570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853b469-9e5e-4a31-9cef-2b6cd94f7379 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:53.275681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853b469-9e5e-4a31-9cef-2b6cd94f7379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:53.338758 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7853b469-9e5e-4a31-9cef-2b6cd94f7379 None None] MFA Rules not processed for user `d63543b997cd4d44b3f069a642b26186`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:53.339963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7853b469-9e5e-4a31-9cef-2b6cd94f7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:53.430484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 662/1330] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:33:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:33:53.467895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fd8a3-59a6-4ef8-ad85-360eaa5dab00 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:33:53.469693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c54fd8a3-59a6-4ef8-ad85-360eaa5dab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:53.567062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fd8a3-59a6-4ef8-ad85-360eaa5dab00 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:33:53.637104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfdc62-9bea-4413-9677-d084a4381a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:33:53.637744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfdc62-9bea-4413-9677-d084a4381a8c service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:53.638049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfdc62-9bea-4413-9677-d084a4381a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:53.638329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfdc62-9bea-4413-9677-d084a4381a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:53.639953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c1dfdc62-9bea-4413-9677-d084a4381a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:53.744294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfdc62-9bea-4413-9677-d084a4381a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:33:53.745689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfdc62-9bea-4413-9677-d084a4381a8c service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:33:53.763785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 669/1331] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:33:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:33:56.387119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20262a85-efa3-41ed-bd95-3e940df20934 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:56.387655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20262a85-efa3-41ed-bd95-3e940df20934 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:56.387749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20262a85-efa3-41ed-bd95-3e940df20934 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:56.389927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 663/1332] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:33:56.395205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4335fd-0f64-4c1b-9a0d-2fd464b856ad None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:56.395661 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4335fd-0f64-4c1b-9a0d-2fd464b856ad None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:56.395756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4335fd-0f64-4c1b-9a0d-2fd464b856ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:56.464147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ca4335fd-0f64-4c1b-9a0d-2fd464b856ad None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:56.465433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ca4335fd-0f64-4c1b-9a0d-2fd464b856ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:56.563465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 670/1333] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:33:56.599443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20262a85-efa3-41ed-bd95-3e940df20934 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:33:56.600953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20262a85-efa3-41ed-bd95-3e940df20934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:56.710559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20262a85-efa3-41ed-bd95-3e940df20934 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:33:56.780136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0d8f-783b-4f02-829a-8d49e7919e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:33:56.780776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0d8f-783b-4f02-829a-8d49e7919e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:56.781054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0d8f-783b-4f02-829a-8d49e7919e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:56.781323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0d8f-783b-4f02-829a-8d49e7919e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:56.782968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20ef0d8f-783b-4f02-829a-8d49e7919e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:56.885937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef0d8f-783b-4f02-829a-8d49e7919e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:33:56.887332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef0d8f-783b-4f02-829a-8d49e7919e50 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:33:56.904781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 664/1334] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:33:59.204896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceffe28-d9dc-4d05-93b3-aa86e30bbaea None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:59.205404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceffe28-d9dc-4d05-93b3-aa86e30bbaea None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:59.205492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceffe28-d9dc-4d05-93b3-aa86e30bbaea None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:59.206860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 671/1335] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:33:59.211982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0663d-a12f-4bcd-8a24-91c0e349b969 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:59.212428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0663d-a12f-4bcd-8a24-91c0e349b969 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:59.212604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0663d-a12f-4bcd-8a24-91c0e349b969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:59.277173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a8b0663d-a12f-4bcd-8a24-91c0e349b969 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:33:59.278408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a8b0663d-a12f-4bcd-8a24-91c0e349b969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:59.370371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 665/1336] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:33:59.408743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceffe28-d9dc-4d05-93b3-aa86e30bbaea None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:33:59.411015 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0ceffe28-d9dc-4d05-93b3-aa86e30bbaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:59.508903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceffe28-d9dc-4d05-93b3-aa86e30bbaea None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:33:59.577392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fca5d-ab54-48ac-9b10-ee0740a1977b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:33:59.578054 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fca5d-ab54-48ac-9b10-ee0740a1977b service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:33:59.578333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fca5d-ab54-48ac-9b10-ee0740a1977b service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:33:59.578604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fca5d-ab54-48ac-9b10-ee0740a1977b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:33:59.580212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ad9fca5d-ab54-48ac-9b10-ee0740a1977b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:33:59.682869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fca5d-ab54-48ac-9b10-ee0740a1977b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:33:59.684230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fca5d-ab54-48ac-9b10-ee0740a1977b service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:33:59.701206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 672/1337] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:02.343666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c0e0-b100-4009-9d39-595892b78a90 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:02.344417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c0e0-b100-4009-9d39-595892b78a90 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:02.344668 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c0e0-b100-4009-9d39-595892b78a90 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:02.346074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 666/1338] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:02.351613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97660a6-0db6-457e-9014-de15799fbaad None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:02.352039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97660a6-0db6-457e-9014-de15799fbaad None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:02.352143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97660a6-0db6-457e-9014-de15799fbaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:02.414501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a97660a6-0db6-457e-9014-de15799fbaad None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:02.415702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a97660a6-0db6-457e-9014-de15799fbaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:02.509854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 673/1339] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:02.545096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c0e0-b100-4009-9d39-595892b78a90 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:02.546918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d04c0e0-b100-4009-9d39-595892b78a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:02.645536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c0e0-b100-4009-9d39-595892b78a90 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:02.715620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09137c22-5a5a-4290-bf7a-6425513ae9ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:02.716258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09137c22-5a5a-4290-bf7a-6425513ae9ed service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:02.716540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09137c22-5a5a-4290-bf7a-6425513ae9ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:02.716814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09137c22-5a5a-4290-bf7a-6425513ae9ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:02.718462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-09137c22-5a5a-4290-bf7a-6425513ae9ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:02.820988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09137c22-5a5a-4290-bf7a-6425513ae9ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:02.822435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09137c22-5a5a-4290-bf7a-6425513ae9ed service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:02.839639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 667/1340] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:06.996046 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b498a4-48b0-42af-9ab2-8828b7932c5f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:06.996568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b498a4-48b0-42af-9ab2-8828b7932c5f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:06.996568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b498a4-48b0-42af-9ab2-8828b7932c5f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:06.997865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 674/1341] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:07.012116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eef036-33c8-4120-a74c-6876ea6f177a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:07.012521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eef036-33c8-4120-a74c-6876ea6f177a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:07.012683 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eef036-33c8-4120-a74c-6876ea6f177a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:07.079502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-88eef036-33c8-4120-a74c-6876ea6f177a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:07.080692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-88eef036-33c8-4120-a74c-6876ea6f177a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:07.181780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 668/1342] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:07.220654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b498a4-48b0-42af-9ab2-8828b7932c5f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:07.222836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f2b498a4-48b0-42af-9ab2-8828b7932c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:07.317781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b498a4-48b0-42af-9ab2-8828b7932c5f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:07.321266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72427ab-2da0-4078-9163-d1efd56a8112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:07.321911 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72427ab-2da0-4078-9163-d1efd56a8112 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:07.322222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72427ab-2da0-4078-9163-d1efd56a8112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:07.322499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72427ab-2da0-4078-9163-d1efd56a8112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:07.331553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72427ab-2da0-4078-9163-d1efd56a8112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:07.332987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72427ab-2da0-4078-9163-d1efd56a8112 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:07.342463 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 675/1343] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:10.282285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f3db-a34b-4902-8a15-71503aa3a6ac None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:10.282851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f3db-a34b-4902-8a15-71503aa3a6ac None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:10.282851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f3db-a34b-4902-8a15-71503aa3a6ac None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:10.284108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 669/1344] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:10.289252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7703d-6cd2-4210-9c48-5b9cd334a3f2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:10.289675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7703d-6cd2-4210-9c48-5b9cd334a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:10.289789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7703d-6cd2-4210-9c48-5b9cd334a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:10.317489 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-32a7703d-6cd2-4210-9c48-5b9cd334a3f2 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:10.318690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-32a7703d-6cd2-4210-9c48-5b9cd334a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:10.393558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 676/1345] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:10.429973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673f3db-a34b-4902-8a15-71503aa3a6ac None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:10.440993 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673f3db-a34b-4902-8a15-71503aa3a6ac None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:10.444662 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb59b79-abc8-47b6-90aa-9e10a196f878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:10.445294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb59b79-abc8-47b6-90aa-9e10a196f878 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:10.445570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb59b79-abc8-47b6-90aa-9e10a196f878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:10.445839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb59b79-abc8-47b6-90aa-9e10a196f878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:10.454690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb59b79-abc8-47b6-90aa-9e10a196f878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:10.456240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb59b79-abc8-47b6-90aa-9e10a196f878 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:10.465312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 670/1346] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:14.756679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b443-642a-42b1-9234-b0fa509d53f4 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:14.757238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b443-642a-42b1-9234-b0fa509d53f4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:14.757238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b443-642a-42b1-9234-b0fa509d53f4 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:14.758610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 677/1347] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:14.763806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338d682-f2ce-4fd1-b5d8-dee0c8ec4ae3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:14.764224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338d682-f2ce-4fd1-b5d8-dee0c8ec4ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:14.764480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338d682-f2ce-4fd1-b5d8-dee0c8ec4ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:14.782158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b338d682-f2ce-4fd1-b5d8-dee0c8ec4ae3 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:14.783328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b338d682-f2ce-4fd1-b5d8-dee0c8ec4ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:14.791614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 671/1348] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:14.827855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38b443-642a-42b1-9234-b0fa509d53f4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:14.829549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7d38b443-642a-42b1-9234-b0fa509d53f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:14.842908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38b443-642a-42b1-9234-b0fa509d53f4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:14.847203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4535bc-f298-409e-8f9e-2278e8333b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:14.847767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4535bc-f298-409e-8f9e-2278e8333b3a service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:14.848049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4535bc-f298-409e-8f9e-2278e8333b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:14.848317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4535bc-f298-409e-8f9e-2278e8333b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:14.856851 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4535bc-f298-409e-8f9e-2278e8333b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:14.858348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4535bc-f298-409e-8f9e-2278e8333b3a service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:14.868332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 678/1349] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:20.087536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b09a-1a3a-460b-b14b-87094ec9295b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:20.088440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b09a-1a3a-460b-b14b-87094ec9295b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:20.089015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b09a-1a3a-460b-b14b-87094ec9295b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:20.090544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 672/1350] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:20.097145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a271-a183-4b50-883b-d7683489c867 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:20.097892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a271-a183-4b50-883b-d7683489c867 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:20.098341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a271-a183-4b50-883b-d7683489c867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:20.168537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3ba5a271-a183-4b50-883b-d7683489c867 None None] MFA Rules not processed for user `8614649160fb4bcca89b18ceeb6c0785`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:20.169729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3ba5a271-a183-4b50-883b-d7683489c867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:20.272235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 679/1351] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:24.659544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0552f-ef0d-41aa-a7e5-ddf43a148ce8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:24.660082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0552f-ef0d-41aa-a7e5-ddf43a148ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:24.660171 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0552f-ef0d-41aa-a7e5-ddf43a148ce8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:24.661463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 673/1352] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:24.667333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a185d1-7977-49b6-9d21-527f4cdff8ff None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:24.667795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a185d1-7977-49b6-9d21-527f4cdff8ff None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:24.667880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a185d1-7977-49b6-9d21-527f4cdff8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:24.686503 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d9a185d1-7977-49b6-9d21-527f4cdff8ff None None] MFA Rules not processed for user `8614649160fb4bcca89b18ceeb6c0785`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:24.688059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d9a185d1-7977-49b6-9d21-527f4cdff8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:24.697425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 680/1353] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:34:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:26.207945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003b55-6d21-451d-80c9-24aa2526a641 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:26.208459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003b55-6d21-451d-80c9-24aa2526a641 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:26.208553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003b55-6d21-451d-80c9-24aa2526a641 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:26.209871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 674/1354] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:26.214793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c4c4f-fdfa-4031-a19e-35e514554594 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:26.215213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c4c4f-fdfa-4031-a19e-35e514554594 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:26.215342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c4c4f-fdfa-4031-a19e-35e514554594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:26.233571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-992c4c4f-fdfa-4031-a19e-35e514554594 None None] MFA Rules not processed for user `8614649160fb4bcca89b18ceeb6c0785`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:26.234893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-992c4c4f-fdfa-4031-a19e-35e514554594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:26.244290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 681/1355] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:34:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:30.111606 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f8266-fd10-400b-b388-46b12db5f4ff None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:30.112105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f8266-fd10-400b-b388-46b12db5f4ff None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:30.112222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f8266-fd10-400b-b388-46b12db5f4ff None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:30.113474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 675/1356] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:30.118991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394afce-649e-4d93-ad4c-ee5c8085aa70 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:30.119794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394afce-649e-4d93-ad4c-ee5c8085aa70 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:30.120148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394afce-649e-4d93-ad4c-ee5c8085aa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:30.139648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a394afce-649e-4d93-ad4c-ee5c8085aa70 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:30.140973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a394afce-649e-4d93-ad4c-ee5c8085aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:30.151311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 682/1357] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:30.197323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b327-adee-4b37-9c22-67faa5af4d02 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:30.197610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b327-adee-4b37-9c22-67faa5af4d02 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:30.197885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b327-adee-4b37-9c22-67faa5af4d02 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:30.199264 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 676/1358] 10.222.0.75 () {54 vars in 961 bytes} [Tue May 17 15:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:30.205533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14648b5e-7bf0-4503-8028-11742e00fe09 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:30.205848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14648b5e-7bf0-4503-8028-11742e00fe09 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:30.206145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14648b5e-7bf0-4503-8028-11742e00fe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:30.261732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-14648b5e-7bf0-4503-8028-11742e00fe09 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:30.262932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-14648b5e-7bf0-4503-8028-11742e00fe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:30.346371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 683/1359] 10.222.0.75 () {58 vars in 1058 bytes} [Tue May 17 15:34:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:30.354305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6b327-adee-4b37-9c22-67faa5af4d02 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:30.368037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6b327-adee-4b37-9c22-67faa5af4d02 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:30.373256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d82a2-4a6d-4889-9550-f1c600c722dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:30.373876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d82a2-4a6d-4889-9550-f1c600c722dc service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:30.374184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d82a2-4a6d-4889-9550-f1c600c722dc service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:30.374453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d82a2-4a6d-4889-9550-f1c600c722dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:30.382688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d82a2-4a6d-4889-9550-f1c600c722dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:30.384257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d82a2-4a6d-4889-9550-f1c600c722dc service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:30.393775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 677/1360] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:32.831345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ac913-81a3-4720-bb66-b02d82887461 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:32.831821 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ac913-81a3-4720-bb66-b02d82887461 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:32.831920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ac913-81a3-4720-bb66-b02d82887461 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:32.833545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 684/1361] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:32.838759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e88e17-25f8-4499-8629-b6a5e4625fd9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:32.839195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e88e17-25f8-4499-8629-b6a5e4625fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:32.839496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e88e17-25f8-4499-8629-b6a5e4625fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:32.858112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f6e88e17-25f8-4499-8629-b6a5e4625fd9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:32.859460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f6e88e17-25f8-4499-8629-b6a5e4625fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:32.867913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 678/1362] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:32.912578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ac913-81a3-4720-bb66-b02d82887461 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:32.927917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ac913-81a3-4720-bb66-b02d82887461 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:32.933767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda62a8f-beaa-4a80-a7aa-2e07798c635c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:32.934509 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda62a8f-beaa-4a80-a7aa-2e07798c635c service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:32.934861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda62a8f-beaa-4a80-a7aa-2e07798c635c service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:32.935204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda62a8f-beaa-4a80-a7aa-2e07798c635c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:32.944204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda62a8f-beaa-4a80-a7aa-2e07798c635c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:32.949547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda62a8f-beaa-4a80-a7aa-2e07798c635c service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:32.959099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 685/1363] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:35.512167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2365a39-b375-45ac-8286-6691a94d21a6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:35.512672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2365a39-b375-45ac-8286-6691a94d21a6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:35.512769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2365a39-b375-45ac-8286-6691a94d21a6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:35.514099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 679/1364] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:35.520062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a14699-c9b4-40a0-8073-d42ee5088d36 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:35.520062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a14699-c9b4-40a0-8073-d42ee5088d36 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:35.520534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a14699-c9b4-40a0-8073-d42ee5088d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:35.538122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-90a14699-c9b4-40a0-8073-d42ee5088d36 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:35.539314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-90a14699-c9b4-40a0-8073-d42ee5088d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:35.546959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 686/1365] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:35.593183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034edc5-4940-4f5a-a764-08d8c1270b33 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:35.593460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034edc5-4940-4f5a-a764-08d8c1270b33 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:35.593727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034edc5-4940-4f5a-a764-08d8c1270b33 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:35.596420 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 680/1366] 10.222.0.75 () {54 vars in 961 bytes} [Tue May 17 15:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:35.603886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16306d60-cd82-4889-9a36-e567f2ff078a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:35.604170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16306d60-cd82-4889-9a36-e567f2ff078a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:35.604452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16306d60-cd82-4889-9a36-e567f2ff078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:35.635138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-16306d60-cd82-4889-9a36-e567f2ff078a None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:35.636673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-16306d60-cd82-4889-9a36-e567f2ff078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:35.651231 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 687/1367] 10.222.0.75 () {58 vars in 1058 bytes} [Tue May 17 15:34:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:35.660315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034edc5-4940-4f5a-a764-08d8c1270b33 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:35.674518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034edc5-4940-4f5a-a764-08d8c1270b33 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:35.679974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660bd49-054a-40b8-8186-b7c04cc06af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:35.680608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660bd49-054a-40b8-8186-b7c04cc06af9 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:35.680885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660bd49-054a-40b8-8186-b7c04cc06af9 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:35.681154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660bd49-054a-40b8-8186-b7c04cc06af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:35.689359 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660bd49-054a-40b8-8186-b7c04cc06af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:35.690942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660bd49-054a-40b8-8186-b7c04cc06af9 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:35.700306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 681/1368] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:37.988301 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b97533-2ac3-4fd1-95a6-7f46a8fa1f81 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:37.988905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b97533-2ac3-4fd1-95a6-7f46a8fa1f81 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:37.988905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b97533-2ac3-4fd1-95a6-7f46a8fa1f81 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:37.990244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 688/1369] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:37.995577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0f9d1-fc33-41f0-a526-8e3f1a902b74 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:37.995991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0f9d1-fc33-41f0-a526-8e3f1a902b74 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:37.996134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0f9d1-fc33-41f0-a526-8e3f1a902b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:38.014257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-83f0f9d1-fc33-41f0-a526-8e3f1a902b74 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:38.015455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-83f0f9d1-fc33-41f0-a526-8e3f1a902b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:38.023479 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 682/1370] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:38.067937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b97533-2ac3-4fd1-95a6-7f46a8fa1f81 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:38.100692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b97533-2ac3-4fd1-95a6-7f46a8fa1f81 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:38.106450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9376d-6fb6-4cac-a691-d54867fd6b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:38.107094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9376d-6fb6-4cac-a691-d54867fd6b03 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:38.107376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9376d-6fb6-4cac-a691-d54867fd6b03 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:38.107636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9376d-6fb6-4cac-a691-d54867fd6b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:38.117320 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9376d-6fb6-4cac-a691-d54867fd6b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:38.119405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9376d-6fb6-4cac-a691-d54867fd6b03 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:38.131329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 689/1371] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:38.333967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba9b2-ad88-47de-9e0f-0e4524aaf2fa None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:38.334239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba9b2-ad88-47de-9e0f-0e4524aaf2fa None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:38.334693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba9b2-ad88-47de-9e0f-0e4524aaf2fa None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:38.337339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 683/1372] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:38.342494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111d97f-9ca4-4284-84e3-baed3b3ccff7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:38.342779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111d97f-9ca4-4284-84e3-baed3b3ccff7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:38.343260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111d97f-9ca4-4284-84e3-baed3b3ccff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:38.363793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6111d97f-9ca4-4284-84e3-baed3b3ccff7 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:38.365350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6111d97f-9ca4-4284-84e3-baed3b3ccff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:38.378032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 690/1373] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:38.653866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d1202-bd81-4713-9b34-4736e305c4d8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:38.654213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d1202-bd81-4713-9b34-4736e305c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:38.654489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d1202-bd81-4713-9b34-4736e305c4d8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:38.656127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 684/1374] 10.222.0.75 () {54 vars in 963 bytes} [Tue May 17 15:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:38.662796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8e95d-2f0d-4afc-9396-e2f61258e6ee None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:38.663157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8e95d-2f0d-4afc-9396-e2f61258e6ee None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:38.663507 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8e95d-2f0d-4afc-9396-e2f61258e6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:38.712167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-50d8e95d-2f0d-4afc-9396-e2f61258e6ee None None] MFA Rules not processed for user `3196743ff7564c16b3cfdae4f0008075`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:38.713938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-50d8e95d-2f0d-4afc-9396-e2f61258e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:38.781424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 691/1375] 10.222.0.75 () {58 vars in 1060 bytes} [Tue May 17 15:34:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:38.788381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d1202-bd81-4713-9b34-4736e305c4d8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:38.801354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d1202-bd81-4713-9b34-4736e305c4d8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:38.805523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f80d03-d6d6-45f5-9ece-89803eb91005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:38.806419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f80d03-d6d6-45f5-9ece-89803eb91005 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:38.806930 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f80d03-d6d6-45f5-9ece-89803eb91005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:38.807418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f80d03-d6d6-45f5-9ece-89803eb91005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:38.817710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f80d03-d6d6-45f5-9ece-89803eb91005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:38.819552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f80d03-d6d6-45f5-9ece-89803eb91005 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:38.830950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 685/1376] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:40.391263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef871da8-22ba-4f4a-a762-6a0c424d97c3 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:40.391918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef871da8-22ba-4f4a-a762-6a0c424d97c3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:40.391918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef871da8-22ba-4f4a-a762-6a0c424d97c3 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:40.393260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 692/1377] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:40.399487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765b11-2447-43a5-8943-bd9af8c16afa None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:40.400069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765b11-2447-43a5-8943-bd9af8c16afa None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:40.400069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765b11-2447-43a5-8943-bd9af8c16afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:40.423867 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-11765b11-2447-43a5-8943-bd9af8c16afa None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:40.425870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-11765b11-2447-43a5-8943-bd9af8c16afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:40.436310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 686/1378] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:34:40.481693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef871da8-22ba-4f4a-a762-6a0c424d97c3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:40.497129 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef871da8-22ba-4f4a-a762-6a0c424d97c3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:40.503267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5a01c-b629-4c48-8b7d-2ea79c44b1c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:40.503954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5a01c-b629-4c48-8b7d-2ea79c44b1c7 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:40.504238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5a01c-b629-4c48-8b7d-2ea79c44b1c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:40.504516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5a01c-b629-4c48-8b7d-2ea79c44b1c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:40.513487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5a01c-b629-4c48-8b7d-2ea79c44b1c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:40.515153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5a01c-b629-4c48-8b7d-2ea79c44b1c7 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:40.527292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 693/1379] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:34:42.852124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e28e66-c1c6-42c6-861c-8234d9e0f540 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:42.852991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e28e66-c1c6-42c6-861c-8234d9e0f540 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:42.853270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e28e66-c1c6-42c6-861c-8234d9e0f540 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:42.854780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 687/1380] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:42.860228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565bee2-1301-4cbe-bf01-fa391b360c08 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:42.861227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565bee2-1301-4cbe-bf01-fa391b360c08 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:42.861739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565bee2-1301-4cbe-bf01-fa391b360c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:42.884151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7565bee2-1301-4cbe-bf01-fa391b360c08 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:42.886725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7565bee2-1301-4cbe-bf01-fa391b360c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:42.898213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 694/1381] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:42.944352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e28e66-c1c6-42c6-861c-8234d9e0f540 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:42.958935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e28e66-c1c6-42c6-861c-8234d9e0f540 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:42.964354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573264c-2083-45ff-9244-cb7ebf7eafe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:42.965060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573264c-2083-45ff-9244-cb7ebf7eafe5 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:42.965527 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573264c-2083-45ff-9244-cb7ebf7eafe5 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:42.965872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573264c-2083-45ff-9244-cb7ebf7eafe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:42.975313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573264c-2083-45ff-9244-cb7ebf7eafe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:42.976988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573264c-2083-45ff-9244-cb7ebf7eafe5 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:42.987085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 688/1382] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:45.230957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc600f-0f7a-4317-b84c-6cbba7aa266a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:45.231899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc600f-0f7a-4317-b84c-6cbba7aa266a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:45.232403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc600f-0f7a-4317-b84c-6cbba7aa266a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:45.237186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 695/1383] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:45.240030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c44bc-3fb5-426c-a8ad-6d794589fc14 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:45.240489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c44bc-3fb5-426c-a8ad-6d794589fc14 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:45.241172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c44bc-3fb5-426c-a8ad-6d794589fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:45.258784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e99c44bc-3fb5-426c-a8ad-6d794589fc14 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:45.259967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e99c44bc-3fb5-426c-a8ad-6d794589fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:45.267762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 689/1384] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:45.308589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc600f-0f7a-4317-b84c-6cbba7aa266a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:45.322900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc600f-0f7a-4317-b84c-6cbba7aa266a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:45.328548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97793e-70f3-4e24-bb73-b75c0e8be4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:45.329371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97793e-70f3-4e24-bb73-b75c0e8be4b3 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:45.329742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97793e-70f3-4e24-bb73-b75c0e8be4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:45.330127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97793e-70f3-4e24-bb73-b75c0e8be4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:45.339527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97793e-70f3-4e24-bb73-b75c0e8be4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:45.341381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97793e-70f3-4e24-bb73-b75c0e8be4b3 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:45.353569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 696/1385] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:47.573465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4c00-1176-4c45-8a9a-97d1c33f053d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:47.573974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4c00-1176-4c45-8a9a-97d1c33f053d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:47.573974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4c00-1176-4c45-8a9a-97d1c33f053d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:47.575433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 690/1386] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:47.581054 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7ae9c-0313-432f-b305-1a0bb6a4b19f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:47.581580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7ae9c-0313-432f-b305-1a0bb6a4b19f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:47.581580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7ae9c-0313-432f-b305-1a0bb6a4b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:47.604150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bbe7ae9c-0313-432f-b305-1a0bb6a4b19f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:47.605655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bbe7ae9c-0313-432f-b305-1a0bb6a4b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:47.616572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 697/1387] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:47.671011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe4c00-1176-4c45-8a9a-97d1c33f053d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:47.686806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe4c00-1176-4c45-8a9a-97d1c33f053d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:47.692962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f2d8-6d84-4796-bf60-995cea8d613b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:47.693746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f2d8-6d84-4796-bf60-995cea8d613b service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:47.694071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f2d8-6d84-4796-bf60-995cea8d613b service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:47.694363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f2d8-6d84-4796-bf60-995cea8d613b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:47.703057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f2d8-6d84-4796-bf60-995cea8d613b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:47.705201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f2d8-6d84-4796-bf60-995cea8d613b service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:47.715047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 691/1388] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:49.995831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f983e-8269-49ae-840c-bcca6514ec50 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:49.996508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f983e-8269-49ae-840c-bcca6514ec50 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:49.996508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f983e-8269-49ae-840c-bcca6514ec50 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:49.997802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 698/1389] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:34:50.003615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048327fd-ce2f-4d94-9af0-2626ecefcebd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:50.004189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048327fd-ce2f-4d94-9af0-2626ecefcebd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:50.004189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048327fd-ce2f-4d94-9af0-2626ecefcebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:50.022090 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-048327fd-ce2f-4d94-9af0-2626ecefcebd None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:50.023373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-048327fd-ce2f-4d94-9af0-2626ecefcebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:50.031015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 692/1390] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:50.077047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f983e-8269-49ae-840c-bcca6514ec50 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:50.094974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f983e-8269-49ae-840c-bcca6514ec50 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:50.101762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577aed-4611-4814-b4f8-f8af1490c977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:50.103353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577aed-4611-4814-b4f8-f8af1490c977 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:50.103929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577aed-4611-4814-b4f8-f8af1490c977 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:50.104289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577aed-4611-4814-b4f8-f8af1490c977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:50.116180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f577aed-4611-4814-b4f8-f8af1490c977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:50.118258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f577aed-4611-4814-b4f8-f8af1490c977 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:50.131131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 699/1391] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:52.862682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a099773-7a1b-48f7-9259-e0a5e5c260fb None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:52.863338 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a099773-7a1b-48f7-9259-e0a5e5c260fb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:52.863338 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a099773-7a1b-48f7-9259-e0a5e5c260fb None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:52.864626 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 693/1392] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:52.869846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9eda-4600-4847-9418-5552a1e4e503 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:52.870278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9eda-4600-4847-9418-5552a1e4e503 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:52.870447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9eda-4600-4847-9418-5552a1e4e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:52.887928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4bfd9eda-4600-4847-9418-5552a1e4e503 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:52.889096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4bfd9eda-4600-4847-9418-5552a1e4e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:52.897546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 700/1393] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:34:52.941636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a099773-7a1b-48f7-9259-e0a5e5c260fb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:52.955489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a099773-7a1b-48f7-9259-e0a5e5c260fb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:52.961090 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2fa19-1693-487d-b630-2bb411798c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:52.961752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2fa19-1693-487d-b630-2bb411798c11 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:52.962062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2fa19-1693-487d-b630-2bb411798c11 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:52.962340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2fa19-1693-487d-b630-2bb411798c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:52.970722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2fa19-1693-487d-b630-2bb411798c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:52.972282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2fa19-1693-487d-b630-2bb411798c11 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:52.981414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 694/1394] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:54.669115 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107fdab-a76c-45bd-bf4a-b426e02fb1f3 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:54.669643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107fdab-a76c-45bd-bf4a-b426e02fb1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:54.669643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107fdab-a76c-45bd-bf4a-b426e02fb1f3 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:54.671155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 701/1395] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:54.677696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90d6c8-b4df-4986-b4c1-672163371117 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:54.678195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90d6c8-b4df-4986-b4c1-672163371117 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:54.678475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90d6c8-b4df-4986-b4c1-672163371117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:54.696362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ec90d6c8-b4df-4986-b4c1-672163371117 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:54.697538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ec90d6c8-b4df-4986-b4c1-672163371117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:54.705518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 695/1396] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:54.761368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681965da-40a7-4fdf-adc4-077d99bfa124 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:54.761654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681965da-40a7-4fdf-adc4-077d99bfa124 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:54.761929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681965da-40a7-4fdf-adc4-077d99bfa124 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:54.763403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 702/1397] 10.222.0.75 () {54 vars in 962 bytes} [Tue May 17 15:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:54.768615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f1c02-7cd6-434d-983c-d78f47e481bf None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:54.768899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f1c02-7cd6-434d-983c-d78f47e481bf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:54.769170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f1c02-7cd6-434d-983c-d78f47e481bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:54.815570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0d7f1c02-7cd6-434d-983c-d78f47e481bf None None] MFA Rules not processed for user `22c0e889e1f842b2a6081f38aabd97ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:54.816745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d7f1c02-7cd6-434d-983c-d78f47e481bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:54.874617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 696/1398] 10.222.0.75 () {58 vars in 1059 bytes} [Tue May 17 15:34:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:54.882247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681965da-40a7-4fdf-adc4-077d99bfa124 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:54.892827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681965da-40a7-4fdf-adc4-077d99bfa124 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:54.896351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240c73e-db11-4f00-a23f-591e695a8a15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22c0e889e1f842b2a6081f38aabd97ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:54.896978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240c73e-db11-4f00-a23f-591e695a8a15 service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:54.897258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240c73e-db11-4f00-a23f-591e695a8a15 service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:54.897533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240c73e-db11-4f00-a23f-591e695a8a15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:54.906327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240c73e-db11-4f00-a23f-591e695a8a15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:54.908321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240c73e-db11-4f00-a23f-591e695a8a15 service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:54.917429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 703/1399] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:55.239869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b43f5-9ef1-4e6b-9190-20ecbd3f3f88 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:55.240165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b43f5-9ef1-4e6b-9190-20ecbd3f3f88 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:55.240447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b43f5-9ef1-4e6b-9190-20ecbd3f3f88 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:55.241806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 697/1400] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:55.247062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695aa63-3066-45e3-9da8-bc9542b89bfd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:55.247294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695aa63-3066-45e3-9da8-bc9542b89bfd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:55.247569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695aa63-3066-45e3-9da8-bc9542b89bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:55.265378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8695aa63-3066-45e3-9da8-bc9542b89bfd None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:55.266651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8695aa63-3066-45e3-9da8-bc9542b89bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:55.274420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 704/1401] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:55.318389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b43f5-9ef1-4e6b-9190-20ecbd3f3f88 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:55.333399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b43f5-9ef1-4e6b-9190-20ecbd3f3f88 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:55.338850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98994a2-114e-4aaf-81a1-ada9fdabf87c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:55.339003 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b008-1cd2-4dfd-98e0-476d2ff6b738 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:55.339155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b008-1cd2-4dfd-98e0-476d2ff6b738 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:55.339433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b008-1cd2-4dfd-98e0-476d2ff6b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:55.339558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98994a2-114e-4aaf-81a1-ada9fdabf87c service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:55.339748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98994a2-114e-4aaf-81a1-ada9fdabf87c service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:55.340020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98994a2-114e-4aaf-81a1-ada9fdabf87c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:55.348448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98994a2-114e-4aaf-81a1-ada9fdabf87c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:55.350027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98994a2-114e-4aaf-81a1-ada9fdabf87c service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:55.359347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 698/1402] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:34:55.388874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f9b8b008-1cd2-4dfd-98e0-476d2ff6b738 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:55.390084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f9b8b008-1cd2-4dfd-98e0-476d2ff6b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:55.456321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 705/1403] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:34:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:34:55.500369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed94e3-337a-465f-9494-57003fe2d559 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:55.500661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed94e3-337a-465f-9494-57003fe2d559 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:55.501648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed94e3-337a-465f-9494-57003fe2d559 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:55.503129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 699/1404] 10.222.0.75 () {54 vars in 942 bytes} [Tue May 17 15:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:55.510088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0472f4-fc4a-4bb3-9110-611cf223d1c1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:55.510377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0472f4-fc4a-4bb3-9110-611cf223d1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:55.510660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0472f4-fc4a-4bb3-9110-611cf223d1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:55.562566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7e0472f4-fc4a-4bb3-9110-611cf223d1c1 None None] MFA Rules not processed for user `db2c811cad8a490891834991a6101984`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:55.563799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7e0472f4-fc4a-4bb3-9110-611cf223d1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:55.635711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 706/1405] 10.222.0.75 () {58 vars in 1039 bytes} [Tue May 17 15:34:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:55.645116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed94e3-337a-465f-9494-57003fe2d559 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:55.659330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed94e3-337a-465f-9494-57003fe2d559 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:55.667384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879276b0-add4-44a4-9d3f-8b45e80eba50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:55.668049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879276b0-add4-44a4-9d3f-8b45e80eba50 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:55.668335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879276b0-add4-44a4-9d3f-8b45e80eba50 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:55.668761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879276b0-add4-44a4-9d3f-8b45e80eba50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:55.679896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879276b0-add4-44a4-9d3f-8b45e80eba50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:55.681466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879276b0-add4-44a4-9d3f-8b45e80eba50 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:55.689443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 700/1406] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:34:57.667073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae189a-1104-4b48-93f9-047e6495a71f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:57.667689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae189a-1104-4b48-93f9-047e6495a71f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:57.667689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae189a-1104-4b48-93f9-047e6495a71f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:57.668991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 707/1407] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:34:57.674861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f16c3-ca05-4258-9a43-5115085a7918 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:57.675673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f16c3-ca05-4258-9a43-5115085a7918 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:57.676105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f16c3-ca05-4258-9a43-5115085a7918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:57.694908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d34f16c3-ca05-4258-9a43-5115085a7918 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:34:57.696335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d34f16c3-ca05-4258-9a43-5115085a7918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:34:57.704276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 701/1408] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:34:57.763630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae189a-1104-4b48-93f9-047e6495a71f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:34:57.780373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae189a-1104-4b48-93f9-047e6495a71f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:34:57.786542 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f1e9-7696-4cac-afe5-48d826f50de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:34:57.787196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f1e9-7696-4cac-afe5-48d826f50de9 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:34:57.787478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f1e9-7696-4cac-afe5-48d826f50de9 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:34:57.787754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f1e9-7696-4cac-afe5-48d826f50de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:34:57.797169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2f1e9-7696-4cac-afe5-48d826f50de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:34:57.799556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2f1e9-7696-4cac-afe5-48d826f50de9 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:34:57.809639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 708/1409] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:35:18.999345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f902-7a97-4061-8b1e-dc4b4fd83d31 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:18.999976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f902-7a97-4061-8b1e-dc4b4fd83d31 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:18.999976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f902-7a97-4061-8b1e-dc4b4fd83d31 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:19.001799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 702/1410] 10.222.0.75 () {54 vars in 918 bytes} [Tue May 17 15:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:35:19.006909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3225-9bbb-47da-aa6a-2dc19e2509db None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:19.007405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3225-9bbb-47da-aa6a-2dc19e2509db None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:19.007518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3225-9bbb-47da-aa6a-2dc19e2509db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:19.025367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-090d3225-9bbb-47da-aa6a-2dc19e2509db None None] MFA Rules not processed for user `8614649160fb4bcca89b18ceeb6c0785`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:19.026571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-090d3225-9bbb-47da-aa6a-2dc19e2509db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:19.035902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 709/1411] 10.222.0.75 () {58 vars in 1015 bytes} [Tue May 17 15:35:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:19.050485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad026-1734-4c19-bed6-2d6da5d8c830 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:19.050774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad026-1734-4c19-bed6-2d6da5d8c830 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:19.051052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad026-1734-4c19-bed6-2d6da5d8c830 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:19.052453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 703/1412] 10.222.0.75 () {54 vars in 918 bytes} [Tue May 17 15:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:19.056822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddcfb7-c3d3-4c5b-bf66-4f815fa47d12 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:19.057108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddcfb7-c3d3-4c5b-bf66-4f815fa47d12 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:19.057386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddcfb7-c3d3-4c5b-bf66-4f815fa47d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:19.074536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b7ddcfb7-c3d3-4c5b-bf66-4f815fa47d12 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:19.075705 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b7ddcfb7-c3d3-4c5b-bf66-4f815fa47d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:19.084750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 710/1413] 10.222.0.75 () {58 vars in 1015 bytes} [Tue May 17 15:35:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:35:21.769536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c5d6-d6be-42a3-b90a-6a9f9edea846 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:21.770138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c5d6-d6be-42a3-b90a-6a9f9edea846 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:21.770138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c5d6-d6be-42a3-b90a-6a9f9edea846 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:21.771489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:21.782935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7a8c-82c2-4f50-937c-f05f9e5e790c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:21.783441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7a8c-82c2-4f50-937c-f05f9e5e790c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:21.783562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7a8c-82c2-4f50-937c-f05f9e5e790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:21.801384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-163d7a8c-82c2-4f50-937c-f05f9e5e790c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:21.802599 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-163d7a8c-82c2-4f50-937c-f05f9e5e790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:21.810292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:21.851172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c5d6-d6be-42a3-b90a-6a9f9edea846 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:21.866027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c5d6-d6be-42a3-b90a-6a9f9edea846 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:21.871409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38fcdf-45b2-4fe1-b9dd-c3feb337506a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:21.872027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38fcdf-45b2-4fe1-b9dd-c3feb337506a service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:21.872305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38fcdf-45b2-4fe1-b9dd-c3feb337506a service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:21.872574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38fcdf-45b2-4fe1-b9dd-c3feb337506a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:21.880478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38fcdf-45b2-4fe1-b9dd-c3feb337506a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:21.882050 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38fcdf-45b2-4fe1-b9dd-c3feb337506a service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:21.890963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 705/1416] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:22.876877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ccf69-2843-4b7e-8876-77598bbfb07e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:22.877436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ccf69-2843-4b7e-8876-77598bbfb07e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:22.877436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ccf69-2843-4b7e-8876-77598bbfb07e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:22.878850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:22.883901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bc577-6bab-4ec3-a4b4-21bed74ba04d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:22.884337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bc577-6bab-4ec3-a4b4-21bed74ba04d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:22.884459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bc577-6bab-4ec3-a4b4-21bed74ba04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:22.903326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0c5bc577-6bab-4ec3-a4b4-21bed74ba04d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:22.904617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0c5bc577-6bab-4ec3-a4b4-21bed74ba04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:22.912655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:23.072016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ccf69-2843-4b7e-8876-77598bbfb07e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:23.085865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ccf69-2843-4b7e-8876-77598bbfb07e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:23.091136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358dfcc-83c6-4f26-822a-c9d6bbc806d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:23.091757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358dfcc-83c6-4f26-822a-c9d6bbc806d1 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:23.092036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358dfcc-83c6-4f26-822a-c9d6bbc806d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:23.092309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358dfcc-83c6-4f26-822a-c9d6bbc806d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:23.100281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358dfcc-83c6-4f26-822a-c9d6bbc806d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:23.101838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358dfcc-83c6-4f26-822a-c9d6bbc806d1 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:23.115494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 713/1419] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:24.050359 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9e860-ac8a-4090-8a08-1e9c7ae64343 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:24.050929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9e860-ac8a-4090-8a08-1e9c7ae64343 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:24.050929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9e860-ac8a-4090-8a08-1e9c7ae64343 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:24.052286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:24.057145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7736f-a5a4-4dab-ae47-12925fd31941 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:24.057549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7736f-a5a4-4dab-ae47-12925fd31941 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:24.057693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7736f-a5a4-4dab-ae47-12925fd31941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:24.075402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-eec7736f-a5a4-4dab-ae47-12925fd31941 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:24.076567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-eec7736f-a5a4-4dab-ae47-12925fd31941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:24.084715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:24.236090 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9e860-ac8a-4090-8a08-1e9c7ae64343 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:24.249927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9e860-ac8a-4090-8a08-1e9c7ae64343 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:24.255743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2072e-ad08-4ea7-b5de-94141f1be8c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:24.256370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2072e-ad08-4ea7-b5de-94141f1be8c7 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:24.256651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2072e-ad08-4ea7-b5de-94141f1be8c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:24.256923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2072e-ad08-4ea7-b5de-94141f1be8c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:24.264938 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2072e-ad08-4ea7-b5de-94141f1be8c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:24.266560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2072e-ad08-4ea7-b5de-94141f1be8c7 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:24.276370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 708/1422] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:25.186796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fb55-0808-4651-8008-3736a0c34dee None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:25.187311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fb55-0808-4651-8008-3736a0c34dee None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:25.187426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fb55-0808-4651-8008-3736a0c34dee None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:25.188684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:25.193439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a45e-082e-4c7b-9dfe-ec433073468b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:25.193875 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a45e-082e-4c7b-9dfe-ec433073468b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:25.193984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a45e-082e-4c7b-9dfe-ec433073468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:25.211873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cec4a45e-082e-4c7b-9dfe-ec433073468b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:25.213056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cec4a45e-082e-4c7b-9dfe-ec433073468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:25.221557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:25.366935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69fb55-0808-4651-8008-3736a0c34dee None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:25.380582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69fb55-0808-4651-8008-3736a0c34dee None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:25.385838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6a684-413f-4c2f-8e47-a6ed24d5d20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:25.386499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6a684-413f-4c2f-8e47-a6ed24d5d20b service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:25.386780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6a684-413f-4c2f-8e47-a6ed24d5d20b service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:25.387060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6a684-413f-4c2f-8e47-a6ed24d5d20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:25.395279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6a684-413f-4c2f-8e47-a6ed24d5d20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:25.396898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6a684-413f-4c2f-8e47-a6ed24d5d20b service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:25.406140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 716/1425] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:26.317792 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41fad-73c1-4489-b8fc-d33eee2c0965 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:26.318348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41fad-73c1-4489-b8fc-d33eee2c0965 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:26.318348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41fad-73c1-4489-b8fc-d33eee2c0965 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:26.320268 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:26.326226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c194c7-3bac-4cdd-94f5-93fbb74ead1c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:26.326704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c194c7-3bac-4cdd-94f5-93fbb74ead1c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:26.327146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c194c7-3bac-4cdd-94f5-93fbb74ead1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:26.346119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d6c194c7-3bac-4cdd-94f5-93fbb74ead1c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:26.347307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d6c194c7-3bac-4cdd-94f5-93fbb74ead1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:26.354959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:26.504478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe41fad-73c1-4489-b8fc-d33eee2c0965 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:26.518328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe41fad-73c1-4489-b8fc-d33eee2c0965 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:26.523575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2141e-ffba-4c71-8784-9f7a1393cefc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:26.524193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2141e-ffba-4c71-8784-9f7a1393cefc service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:26.524469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2141e-ffba-4c71-8784-9f7a1393cefc service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:26.524735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2141e-ffba-4c71-8784-9f7a1393cefc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:26.532912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2141e-ffba-4c71-8784-9f7a1393cefc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:26.534518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2141e-ffba-4c71-8784-9f7a1393cefc service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:26.543418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 711/1428] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:27.418316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215c212-92f9-423a-ad9f-38c6ffa73bf8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:27.418826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215c212-92f9-423a-ad9f-38c6ffa73bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:27.418826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215c212-92f9-423a-ad9f-38c6ffa73bf8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:27.420162 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:27.425045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3aab8-f76c-48b9-8a9b-6043e9046d27 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:27.425470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3aab8-f76c-48b9-8a9b-6043e9046d27 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:27.425616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3aab8-f76c-48b9-8a9b-6043e9046d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:27.445716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4df3aab8-f76c-48b9-8a9b-6043e9046d27 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:27.446931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4df3aab8-f76c-48b9-8a9b-6043e9046d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:27.455181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:27.601271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215c212-92f9-423a-ad9f-38c6ffa73bf8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:27.615375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215c212-92f9-423a-ad9f-38c6ffa73bf8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:27.620682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f83851-de60-4f58-bd38-bd55c308853a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:27.621310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83851-de60-4f58-bd38-bd55c308853a service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:27.621589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83851-de60-4f58-bd38-bd55c308853a service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:27.621863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83851-de60-4f58-bd38-bd55c308853a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:27.629748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83851-de60-4f58-bd38-bd55c308853a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:27.631358 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83851-de60-4f58-bd38-bd55c308853a service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:27.640572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 719/1431] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:28.508798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4b43f-e2d5-478e-9b6a-eacda59330e7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:28.509323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4b43f-e2d5-478e-9b6a-eacda59330e7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:28.509323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4b43f-e2d5-478e-9b6a-eacda59330e7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:28.510677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:35:28.515591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f29e8e-1063-4e86-b15d-a437e5bad161 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:28.515991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f29e8e-1063-4e86-b15d-a437e5bad161 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:28.516151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f29e8e-1063-4e86-b15d-a437e5bad161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:28.534315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e6f29e8e-1063-4e86-b15d-a437e5bad161 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:28.535510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e6f29e8e-1063-4e86-b15d-a437e5bad161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:28.543501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:28.690631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4b43f-e2d5-478e-9b6a-eacda59330e7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:28.704516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4b43f-e2d5-478e-9b6a-eacda59330e7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:28.709848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfcf2e-0cf5-45f0-bd91-238e5083b485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:28.710518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfcf2e-0cf5-45f0-bd91-238e5083b485 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:28.710796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfcf2e-0cf5-45f0-bd91-238e5083b485 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:28.711066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfcf2e-0cf5-45f0-bd91-238e5083b485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:28.718765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfcf2e-0cf5-45f0-bd91-238e5083b485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:28.721068 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfcf2e-0cf5-45f0-bd91-238e5083b485 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:28.729982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 714/1434] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:29.600465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b96200-8a81-466c-84b8-e308f23444cb None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:29.600997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b96200-8a81-466c-84b8-e308f23444cb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:29.600997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b96200-8a81-466c-84b8-e308f23444cb None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:29.602351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:29.607281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a95cbc-cf8f-44b2-99fd-d13efe738794 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:29.607726 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a95cbc-cf8f-44b2-99fd-d13efe738794 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:29.607830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a95cbc-cf8f-44b2-99fd-d13efe738794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:29.624991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c5a95cbc-cf8f-44b2-99fd-d13efe738794 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:29.626716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c5a95cbc-cf8f-44b2-99fd-d13efe738794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:29.634706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:29.781939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b96200-8a81-466c-84b8-e308f23444cb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:29.796170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b96200-8a81-466c-84b8-e308f23444cb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:29.803711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82874f0-8c23-47e7-9420-94f1934445aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:29.804644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82874f0-8c23-47e7-9420-94f1934445aa service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:29.805068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82874f0-8c23-47e7-9420-94f1934445aa service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:29.805489 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82874f0-8c23-47e7-9420-94f1934445aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:29.817954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82874f0-8c23-47e7-9420-94f1934445aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:29.820450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82874f0-8c23-47e7-9420-94f1934445aa service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:29.833290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 722/1437] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:30.690355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93f05d-41f8-4105-9fdd-2e10c073fb8f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:30.690921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93f05d-41f8-4105-9fdd-2e10c073fb8f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:30.690921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93f05d-41f8-4105-9fdd-2e10c073fb8f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:30.692247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:30.697176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642af47-6460-40bc-959d-d4fc038c58a9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:30.697601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642af47-6460-40bc-959d-d4fc038c58a9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:30.697739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642af47-6460-40bc-959d-d4fc038c58a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:30.716614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5642af47-6460-40bc-959d-d4fc038c58a9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:30.717829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5642af47-6460-40bc-959d-d4fc038c58a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:30.726406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:30.875384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93f05d-41f8-4105-9fdd-2e10c073fb8f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:30.890364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93f05d-41f8-4105-9fdd-2e10c073fb8f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:30.897042 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea0a9d-7c9d-4245-bb4d-523286ddcd84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:30.898191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea0a9d-7c9d-4245-bb4d-523286ddcd84 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:30.898476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea0a9d-7c9d-4245-bb4d-523286ddcd84 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:30.898747 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea0a9d-7c9d-4245-bb4d-523286ddcd84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:30.908958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea0a9d-7c9d-4245-bb4d-523286ddcd84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:30.910569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea0a9d-7c9d-4245-bb4d-523286ddcd84 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:30.921831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 717/1440] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:32.985389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601e3ec-6ee9-4cca-ac58-cd4d1b4a6b26 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:32.985921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601e3ec-6ee9-4cca-ac58-cd4d1b4a6b26 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:32.985921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601e3ec-6ee9-4cca-ac58-cd4d1b4a6b26 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:32.987349 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:32.992488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef36c20-add2-4f4e-b48a-260312f18ee0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:32.992910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef36c20-add2-4f4e-b48a-260312f18ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:32.993046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef36c20-add2-4f4e-b48a-260312f18ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:33.010691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5ef36c20-add2-4f4e-b48a-260312f18ee0 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:33.012950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5ef36c20-add2-4f4e-b48a-260312f18ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:33.021642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:33.058667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601e3ec-6ee9-4cca-ac58-cd4d1b4a6b26 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:33.069504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601e3ec-6ee9-4cca-ac58-cd4d1b4a6b26 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:33.072978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9169-25e6-463c-8305-f4f4aed019e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:33.073655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9169-25e6-463c-8305-f4f4aed019e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:33.073889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9169-25e6-463c-8305-f4f4aed019e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:33.074194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9169-25e6-463c-8305-f4f4aed019e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:33.083461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f9169-25e6-463c-8305-f4f4aed019e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:33.084890 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f9169-25e6-463c-8305-f4f4aed019e3 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:33.093992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 725/1443] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:35.451483 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1f45e-e262-4f36-86e5-0533894d71c7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:35.452010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1f45e-e262-4f36-86e5-0533894d71c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:35.452010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1f45e-e262-4f36-86e5-0533894d71c7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:35.453359 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:35.458767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4847735-23c8-46e2-adf8-b44ceb4ee8a6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:35.459174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4847735-23c8-46e2-adf8-b44ceb4ee8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:35.459321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4847735-23c8-46e2-adf8-b44ceb4ee8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:35.477010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d4847735-23c8-46e2-adf8-b44ceb4ee8a6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:35.478208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d4847735-23c8-46e2-adf8-b44ceb4ee8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:35.486340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:35.523203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1f45e-e262-4f36-86e5-0533894d71c7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:35.534111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1f45e-e262-4f36-86e5-0533894d71c7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:35.537565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaf751-bdd3-4018-ba10-c7e8b0c23331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:35.538212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaf751-bdd3-4018-ba10-c7e8b0c23331 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:35.538493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaf751-bdd3-4018-ba10-c7e8b0c23331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:35.538767 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaf751-bdd3-4018-ba10-c7e8b0c23331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:35.547328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaf751-bdd3-4018-ba10-c7e8b0c23331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:35.549352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaf751-bdd3-4018-ba10-c7e8b0c23331 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:35.558417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 720/1446] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:38.128697 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf824c-5b20-4507-b604-2b399561699b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:38.129505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf824c-5b20-4507-b604-2b399561699b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:38.130086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf824c-5b20-4507-b604-2b399561699b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:38.131834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:38.137326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97da4a5-e92a-4954-9c23-dbfffa02e969 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:38.137794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97da4a5-e92a-4954-9c23-dbfffa02e969 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:38.138416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97da4a5-e92a-4954-9c23-dbfffa02e969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:38.155786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f97da4a5-e92a-4954-9c23-dbfffa02e969 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:38.157085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f97da4a5-e92a-4954-9c23-dbfffa02e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:38.164930 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:38.203051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf824c-5b20-4507-b604-2b399561699b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:38.213897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf824c-5b20-4507-b604-2b399561699b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:38.217415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60dc4-c07b-4740-ae7a-808b01787ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:38.218098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60dc4-c07b-4740-ae7a-808b01787ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:38.218523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60dc4-c07b-4740-ae7a-808b01787ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:38.218809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60dc4-c07b-4740-ae7a-808b01787ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:38.227826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60dc4-c07b-4740-ae7a-808b01787ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:38.229274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60dc4-c07b-4740-ae7a-808b01787ec1 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:38.239434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 728/1449] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:40.552806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19cf2-8086-4a39-9c52-a6472f9cbb7d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:40.553361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19cf2-8086-4a39-9c52-a6472f9cbb7d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:40.553361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19cf2-8086-4a39-9c52-a6472f9cbb7d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:40.554654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:40.560170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33b55-d3f0-4202-8987-c25e6d1cec79 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:40.560643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33b55-d3f0-4202-8987-c25e6d1cec79 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:40.560750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33b55-d3f0-4202-8987-c25e6d1cec79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:40.577736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-51b33b55-d3f0-4202-8987-c25e6d1cec79 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:40.578989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-51b33b55-d3f0-4202-8987-c25e6d1cec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:40.586593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:40.624234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19cf2-8086-4a39-9c52-a6472f9cbb7d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:40.634663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19cf2-8086-4a39-9c52-a6472f9cbb7d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:40.638137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2ea15-dffd-45ac-b8f0-dafa1d290a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:40.638764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2ea15-dffd-45ac-b8f0-dafa1d290a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:40.639047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2ea15-dffd-45ac-b8f0-dafa1d290a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:40.639318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2ea15-dffd-45ac-b8f0-dafa1d290a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:40.647934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2ea15-dffd-45ac-b8f0-dafa1d290a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:40.649342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2ea15-dffd-45ac-b8f0-dafa1d290a67 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:40.658936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 723/1452] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:35:42.893878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26969f-d30f-4c22-8f07-573412081570 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:42.894491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26969f-d30f-4c22-8f07-573412081570 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:42.894491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26969f-d30f-4c22-8f07-573412081570 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:42.895813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:42.901477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cf7d4-7404-4e2b-87cc-d24b4c9534bb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:42.901929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cf7d4-7404-4e2b-87cc-d24b4c9534bb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:42.902081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cf7d4-7404-4e2b-87cc-d24b4c9534bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:42.919493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9d8cf7d4-7404-4e2b-87cc-d24b4c9534bb None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:42.920666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d8cf7d4-7404-4e2b-87cc-d24b4c9534bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:42.928887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:35:42.967358 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26969f-d30f-4c22-8f07-573412081570 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:42.978556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26969f-d30f-4c22-8f07-573412081570 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:42.981987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4f240-fbf1-4527-9635-94e760ce3b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:42.982641 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f240-fbf1-4527-9635-94e760ce3b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:42.982920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f240-fbf1-4527-9635-94e760ce3b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:42.983193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f240-fbf1-4527-9635-94e760ce3b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:42.992803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4f240-fbf1-4527-9635-94e760ce3b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:42.994250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4f240-fbf1-4527-9635-94e760ce3b98 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:43.003629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 731/1455] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:45.448930 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4988-bcd8-425d-95a5-aeea88361380 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:45.449455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4988-bcd8-425d-95a5-aeea88361380 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:45.449455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4988-bcd8-425d-95a5-aeea88361380 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:45.450791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:45.456083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba534-34ed-47eb-bf11-8cbb2e5cac6f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:45.456478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba534-34ed-47eb-bf11-8cbb2e5cac6f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:45.456636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba534-34ed-47eb-bf11-8cbb2e5cac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:45.473994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d1dba534-34ed-47eb-bf11-8cbb2e5cac6f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:45.475204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d1dba534-34ed-47eb-bf11-8cbb2e5cac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:45.482932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:45.520482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4988-bcd8-425d-95a5-aeea88361380 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:45.530833 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4988-bcd8-425d-95a5-aeea88361380 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:45.534523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435e1f-6e27-4700-b447-c4c20e4ea584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:45.535147 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435e1f-6e27-4700-b447-c4c20e4ea584 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:45.535424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435e1f-6e27-4700-b447-c4c20e4ea584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:45.535694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435e1f-6e27-4700-b447-c4c20e4ea584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:45.544296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d435e1f-6e27-4700-b447-c4c20e4ea584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:45.545697 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d435e1f-6e27-4700-b447-c4c20e4ea584 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:45.555518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 726/1458] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:47.783249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffab86-669c-4415-934b-534ab7be2774 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:47.783831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffab86-669c-4415-934b-534ab7be2774 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:47.783831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffab86-669c-4415-934b-534ab7be2774 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:47.785134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:47.790370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74777978-dd4d-453c-a4e0-0752fb3500cc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:47.790802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74777978-dd4d-453c-a4e0-0752fb3500cc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:47.790912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74777978-dd4d-453c-a4e0-0752fb3500cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:47.807890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-74777978-dd4d-453c-a4e0-0752fb3500cc None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:47.809069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-74777978-dd4d-453c-a4e0-0752fb3500cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:47.816616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:35:47.855196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffab86-669c-4415-934b-534ab7be2774 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:47.865592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffab86-669c-4415-934b-534ab7be2774 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:47.869101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077915fe-f04e-4afb-8323-9b1bca11462c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:47.869726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077915fe-f04e-4afb-8323-9b1bca11462c service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:47.870028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077915fe-f04e-4afb-8323-9b1bca11462c service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:47.870308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077915fe-f04e-4afb-8323-9b1bca11462c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:47.878944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077915fe-f04e-4afb-8323-9b1bca11462c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:47.880416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077915fe-f04e-4afb-8323-9b1bca11462c service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:47.889434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 734/1461] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:50.114261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a5b9-c447-48c4-b62a-3c5cabe41758 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:50.114842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a5b9-c447-48c4-b62a-3c5cabe41758 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:50.114842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a5b9-c447-48c4-b62a-3c5cabe41758 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:50.116350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:50.121849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ad557-d6cb-4fc5-b01d-082c60af8d5c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:50.122341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ad557-d6cb-4fc5-b01d-082c60af8d5c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:50.122437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ad557-d6cb-4fc5-b01d-082c60af8d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:50.139736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8f1ad557-d6cb-4fc5-b01d-082c60af8d5c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:50.140942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8f1ad557-d6cb-4fc5-b01d-082c60af8d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:50.149426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:35:50.186966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a5b9-c447-48c4-b62a-3c5cabe41758 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:50.197295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a5b9-c447-48c4-b62a-3c5cabe41758 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:50.200762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748bba1-33cd-4fa8-97ea-5217ef3c9a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:50.201382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748bba1-33cd-4fa8-97ea-5217ef3c9a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:50.201658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748bba1-33cd-4fa8-97ea-5217ef3c9a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:50.201927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748bba1-33cd-4fa8-97ea-5217ef3c9a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:50.210991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748bba1-33cd-4fa8-97ea-5217ef3c9a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:50.212383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748bba1-33cd-4fa8-97ea-5217ef3c9a91 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:50.222496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 729/1464] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:52.432850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10e9e0-6bf7-459e-9346-9a18c989ee24 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:52.433359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10e9e0-6bf7-459e-9346-9a18c989ee24 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:52.433359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10e9e0-6bf7-459e-9346-9a18c989ee24 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:52.434757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:52.440153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3973-705e-4a75-b16c-7cc3358ea09f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:52.440599 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3973-705e-4a75-b16c-7cc3358ea09f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:52.440706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3973-705e-4a75-b16c-7cc3358ea09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:52.458468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8a9c3973-705e-4a75-b16c-7cc3358ea09f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:52.459666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8a9c3973-705e-4a75-b16c-7cc3358ea09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:52.467446 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:35:52.505717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10e9e0-6bf7-459e-9346-9a18c989ee24 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:52.516197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10e9e0-6bf7-459e-9346-9a18c989ee24 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:52.520206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebc1ed-a587-4a7b-b364-136291b2d62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:52.520837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebc1ed-a587-4a7b-b364-136291b2d62c service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:52.521121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebc1ed-a587-4a7b-b364-136291b2d62c service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:52.521396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebc1ed-a587-4a7b-b364-136291b2d62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:52.530062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebc1ed-a587-4a7b-b364-136291b2d62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:52.531486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebc1ed-a587-4a7b-b364-136291b2d62c service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:52.540589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 737/1467] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:35:54.740003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e126e3-9680-4541-a85e-d1bb996fd310 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:54.740547 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e126e3-9680-4541-a85e-d1bb996fd310 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:54.740547 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e126e3-9680-4541-a85e-d1bb996fd310 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:54.741946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:35:54.747246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f886f8-2f8b-4c1e-b10f-1875fffd4ca6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:54.747648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f886f8-2f8b-4c1e-b10f-1875fffd4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:54.747798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f886f8-2f8b-4c1e-b10f-1875fffd4ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:54.765378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f0f886f8-2f8b-4c1e-b10f-1875fffd4ca6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:35:54.766611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0f886f8-2f8b-4c1e-b10f-1875fffd4ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:35:54.774376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:35:54.810564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e126e3-9680-4541-a85e-d1bb996fd310 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:35:54.820769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e126e3-9680-4541-a85e-d1bb996fd310 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:35:54.824199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14561fb-260a-4b3c-9028-0a9f96ad2426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:35:54.824815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14561fb-260a-4b3c-9028-0a9f96ad2426 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:35:54.825093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14561fb-260a-4b3c-9028-0a9f96ad2426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:35:54.825365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14561fb-260a-4b3c-9028-0a9f96ad2426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:35:54.834286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14561fb-260a-4b3c-9028-0a9f96ad2426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:35:54.835705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14561fb-260a-4b3c-9028-0a9f96ad2426 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:35:54.845257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 732/1470] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:36:27.800244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc8120-d0e5-4846-88a4-cd0dc537a5bf None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:27.800845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc8120-d0e5-4846-88a4-cd0dc537a5bf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:27.800845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc8120-d0e5-4846-88a4-cd0dc537a5bf None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:27.802201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 739/1471] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:36:27.807152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fd0d9-4bc4-40dc-99be-b0d49650eb35 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:27.807556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fd0d9-4bc4-40dc-99be-b0d49650eb35 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:27.807706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fd0d9-4bc4-40dc-99be-b0d49650eb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:27.825110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cc4fd0d9-4bc4-40dc-99be-b0d49650eb35 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:36:27.826384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cc4fd0d9-4bc4-40dc-99be-b0d49650eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:36:27.834569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 733/1472] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:36:27.880583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc0bb-55ff-4da2-8889-09d3f84921c2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:27.880870 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc0bb-55ff-4da2-8889-09d3f84921c2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:27.881147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc0bb-55ff-4da2-8889-09d3f84921c2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:27.882535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 740/1473] 10.222.0.75 () {54 vars in 962 bytes} [Tue May 17 15:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:36:27.887314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c04eb-78f1-4bff-8d6f-b25473c0229f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:27.887605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c04eb-78f1-4bff-8d6f-b25473c0229f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:27.887882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c04eb-78f1-4bff-8d6f-b25473c0229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:27.905759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aa8c04eb-78f1-4bff-8d6f-b25473c0229f None None] MFA Rules not processed for user `22c0e889e1f842b2a6081f38aabd97ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:36:27.906985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aa8c04eb-78f1-4bff-8d6f-b25473c0229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:36:27.913208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 734/1474] 10.222.0.75 () {58 vars in 1059 bytes} [Tue May 17 15:36:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:36:27.920125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc0bb-55ff-4da2-8889-09d3f84921c2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:36:27.930397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc0bb-55ff-4da2-8889-09d3f84921c2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:36:27.933988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75c1e2-cd9a-46f7-a619-23a974dd0560 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22c0e889e1f842b2a6081f38aabd97ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:36:27.934630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c1e2-cd9a-46f7-a619-23a974dd0560 service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:27.934912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c1e2-cd9a-46f7-a619-23a974dd0560 service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:27.935186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c1e2-cd9a-46f7-a619-23a974dd0560 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:27.944495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75c1e2-cd9a-46f7-a619-23a974dd0560 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:36:27.945916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75c1e2-cd9a-46f7-a619-23a974dd0560 service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:36:27.955624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 741/1475] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:36:30.268776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc77a-422d-48c4-a1d3-4774bc70152a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:30.269345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc77a-422d-48c4-a1d3-4774bc70152a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:30.269345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc77a-422d-48c4-a1d3-4774bc70152a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:30.270732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 735/1476] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:36:30.275852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2ac33-f90b-45d6-9485-e4ff1ed3d669 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:30.276278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2ac33-f90b-45d6-9485-e4ff1ed3d669 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:30.276430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2ac33-f90b-45d6-9485-e4ff1ed3d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:30.296758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-42e2ac33-f90b-45d6-9485-e4ff1ed3d669 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:36:30.298610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-42e2ac33-f90b-45d6-9485-e4ff1ed3d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:36:30.306471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 742/1477] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:36:30.329173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bc77a-422d-48c4-a1d3-4774bc70152a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:36:30.341473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bc77a-422d-48c4-a1d3-4774bc70152a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:36:30.346447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c809d-4312-4da3-b272-f6275095c476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:36:30.347351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c809d-4312-4da3-b272-f6275095c476 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:30.347632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c809d-4312-4da3-b272-f6275095c476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:30.347906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c809d-4312-4da3-b272-f6275095c476 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:30.348679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c809d-4312-4da3-b272-f6275095c476 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:36:30.350445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-a39c809d-4312-4da3-b272-f6275095c476 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:36:30.350445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) May 17 15:36:30.350445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: May 17 15:36:30.351577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c809d-4312-4da3-b272-f6275095c476 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:36:30.371094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 736/1478] 10.222.0.75 () {56 vars in 1108 bytes} [Tue May 17 15:36:30 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:36:32.582644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0619c0-febe-49cf-9fa7-aadae532c940 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:32.583164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0619c0-febe-49cf-9fa7-aadae532c940 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:32.583164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0619c0-febe-49cf-9fa7-aadae532c940 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:32.584597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 743/1479] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:36:32.589809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874e948-f60a-455e-b96e-cf772150e612 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:32.590248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874e948-f60a-455e-b96e-cf772150e612 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:32.590401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874e948-f60a-455e-b96e-cf772150e612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:32.607873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3874e948-f60a-455e-b96e-cf772150e612 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:36:32.609046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3874e948-f60a-455e-b96e-cf772150e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:36:32.616659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 737/1480] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:36:32.658776 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0619c0-febe-49cf-9fa7-aadae532c940 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:36:32.674339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0619c0-febe-49cf-9fa7-aadae532c940 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:36:32.679759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7030f-000e-43d2-8ceb-05a6b38abb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:36:32.680423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7030f-000e-43d2-8ceb-05a6b38abb90 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:32.680709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7030f-000e-43d2-8ceb-05a6b38abb90 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:32.680985 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7030f-000e-43d2-8ceb-05a6b38abb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:32.689536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7030f-000e-43d2-8ceb-05a6b38abb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:36:32.691143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7030f-000e-43d2-8ceb-05a6b38abb90 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:36:32.700414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 744/1481] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:36:35.061956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bfe28-8999-4b91-84cc-2ca221d78d56 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:35.062565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bfe28-8999-4b91-84cc-2ca221d78d56 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:35.062565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bfe28-8999-4b91-84cc-2ca221d78d56 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:35.063996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 738/1482] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:36:35.069246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd931cc6-0820-4780-8878-6a160aceb886 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:35.069638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd931cc6-0820-4780-8878-6a160aceb886 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:35.069801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd931cc6-0820-4780-8878-6a160aceb886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:35.087371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fd931cc6-0820-4780-8878-6a160aceb886 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:36:35.088559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fd931cc6-0820-4780-8878-6a160aceb886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:36:35.096797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 745/1483] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:36:35.131810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bfe28-8999-4b91-84cc-2ca221d78d56 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:36:35.142736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bfe28-8999-4b91-84cc-2ca221d78d56 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:36:35.146259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6768469-3a33-4c5c-a973-94b389b51881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:36:35.146890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768469-3a33-4c5c-a973-94b389b51881 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:35.147173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768469-3a33-4c5c-a973-94b389b51881 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:35.147447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768469-3a33-4c5c-a973-94b389b51881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:35.156207 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768469-3a33-4c5c-a973-94b389b51881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:36:35.158280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768469-3a33-4c5c-a973-94b389b51881 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:36:35.167369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 739/1484] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:36:37.439529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20094907-2818-4c8a-835f-de3dde94d002 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:37.440042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20094907-2818-4c8a-835f-de3dde94d002 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:37.440042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20094907-2818-4c8a-835f-de3dde94d002 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:37.441508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 746/1485] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:36:37.446614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab98f6f-0d46-4c72-8e14-9d720c7a9333 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:37.447021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab98f6f-0d46-4c72-8e14-9d720c7a9333 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:37.447249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab98f6f-0d46-4c72-8e14-9d720c7a9333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:37.465795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dab98f6f-0d46-4c72-8e14-9d720c7a9333 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:36:37.467109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dab98f6f-0d46-4c72-8e14-9d720c7a9333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:36:37.475566 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 740/1486] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:36:37.514422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20094907-2818-4c8a-835f-de3dde94d002 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:36:37.526530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20094907-2818-4c8a-835f-de3dde94d002 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:36:37.529971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e332e-3c1e-4fb8-be67-9cc0f9489395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:36:37.530633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e332e-3c1e-4fb8-be67-9cc0f9489395 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:37.530913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e332e-3c1e-4fb8-be67-9cc0f9489395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:37.531197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e332e-3c1e-4fb8-be67-9cc0f9489395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:37.539836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e332e-3c1e-4fb8-be67-9cc0f9489395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:36:37.541269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e332e-3c1e-4fb8-be67-9cc0f9489395 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:36:37.550518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 747/1487] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:36:39.964253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d4928-8823-4ae4-aa15-5184d0091d67 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:39.964857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d4928-8823-4ae4-aa15-5184d0091d67 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:39.964857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d4928-8823-4ae4-aa15-5184d0091d67 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:39.966254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 741/1488] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:36:39.971914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30cf6-e640-4be0-b8fd-73fae82d5296 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:39.972596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30cf6-e640-4be0-b8fd-73fae82d5296 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:39.972728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30cf6-e640-4be0-b8fd-73fae82d5296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:39.990362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bce30cf6-e640-4be0-b8fd-73fae82d5296 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:36:39.991524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bce30cf6-e640-4be0-b8fd-73fae82d5296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:36:39.999129 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 748/1489] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:36:40.038286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d4928-8823-4ae4-aa15-5184d0091d67 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:36:40.049445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d4928-8823-4ae4-aa15-5184d0091d67 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:36:40.052934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554c929-a685-423c-a014-b523ba70cfb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:36:40.053567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554c929-a685-423c-a014-b523ba70cfb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:40.053843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554c929-a685-423c-a014-b523ba70cfb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:40.054152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554c929-a685-423c-a014-b523ba70cfb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:40.062813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554c929-a685-423c-a014-b523ba70cfb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:36:40.064219 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554c929-a685-423c-a014-b523ba70cfb1 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:36:40.073435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 742/1490] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:36:42.448694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abbe14-4340-4f57-8c96-f2d56c4abafe None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:42.449251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abbe14-4340-4f57-8c96-f2d56c4abafe None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:42.449251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abbe14-4340-4f57-8c96-f2d56c4abafe None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:42.450553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 749/1491] 10.222.0.75 () {54 vars in 926 bytes} [Tue May 17 15:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:36:42.455665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d51dd-79ae-4ff9-b9f9-a6a4491e873e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:42.456119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d51dd-79ae-4ff9-b9f9-a6a4491e873e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:42.456224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d51dd-79ae-4ff9-b9f9-a6a4491e873e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:42.474415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e95d51dd-79ae-4ff9-b9f9-a6a4491e873e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:36:42.475592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e95d51dd-79ae-4ff9-b9f9-a6a4491e873e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:36:42.483526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 743/1492] 10.222.0.75 () {58 vars in 1023 bytes} [Tue May 17 15:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:36:42.521390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abbe14-4340-4f57-8c96-f2d56c4abafe None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:36:42.531862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abbe14-4340-4f57-8c96-f2d56c4abafe None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:36:42.535368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9c974-409f-448c-9211-50dff33f8641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:36:42.535996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9c974-409f-448c-9211-50dff33f8641 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:36:42.536280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9c974-409f-448c-9211-50dff33f8641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:36:42.536548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9c974-409f-448c-9211-50dff33f8641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:36:42.545163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9c974-409f-448c-9211-50dff33f8641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:36:42.546629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9c974-409f-448c-9211-50dff33f8641 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:36:42.556240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 750/1493] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:38:09.310587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0db0e3-d6e6-4435-ab96-258ad0ec8336 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.311164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0db0e3-d6e6-4435-ab96-258ad0ec8336 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.311164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0db0e3-d6e6-4435-ab96-258ad0ec8336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.328240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aa0db0e3-d6e6-4435-ab96-258ad0ec8336 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:38:09.329404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aa0db0e3-d6e6-4435-ab96-258ad0ec8336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:38:09.336975 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 744/1494] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:38:09.346510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead794a-88e8-4ef4-ab02-4e8071ddf9c9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.346991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead794a-88e8-4ef4-ab02-4e8071ddf9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.347109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead794a-88e8-4ef4-ab02-4e8071ddf9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.365028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bead794a-88e8-4ef4-ab02-4e8071ddf9c9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:38:09.366247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bead794a-88e8-4ef4-ab02-4e8071ddf9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:38:09.373944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 751/1495] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:38:09.378217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0db0e3-d6e6-4435-ab96-258ad0ec8336 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:09.387314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0db0e3-d6e6-4435-ab96-258ad0ec8336 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:09.396099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:09.396733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.397069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.397360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.398150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:38:09.398457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:09.400222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:38:09.400222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) May 17 15:38:09.400222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: May 17 15:38:09.401116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:09.421225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 745/1496] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:38:09.429261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead794a-88e8-4ef4-ab02-4e8071ddf9c9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:09.438251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead794a-88e8-4ef4-ab02-4e8071ddf9c9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:09.442726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27255c77-372a-4413-be34-64ce9dd4c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:09.443365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255c77-372a-4413-be34-64ce9dd4c22b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.443646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255c77-372a-4413-be34-64ce9dd4c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.443997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255c77-372a-4413-be34-64ce9dd4c22b admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.444593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27255c77-372a-4413-be34-64ce9dd4c22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:09.446392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-27255c77-372a-4413-be34-64ce9dd4c22b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:38:09.446392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) May 17 15:38:09.446392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: May 17 15:38:09.447579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27255c77-372a-4413-be34-64ce9dd4c22b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:09.483184 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 752/1497] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:38:09 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:38:09.487519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:09.497138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e900a5-a678-4226-84fe-871e9409b64a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:09.549563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e61d-8405-423d-9433-dfb9b105bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:09.550242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e61d-8405-423d-9433-dfb9b105bdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.550524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e61d-8405-423d-9433-dfb9b105bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.550797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e61d-8405-423d-9433-dfb9b105bdd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.551469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093e61d-8405-423d-9433-dfb9b105bdd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:09.552465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-1093e61d-8405-423d-9433-dfb9b105bdd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:38:09.552465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) May 17 15:38:09.552465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: May 17 15:38:09.553655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093e61d-8405-423d-9433-dfb9b105bdd6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:09.571442 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 746/1498] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:38:09 2022] POST /identity/v3/users => generated 290 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:38:09.575579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27255c77-372a-4413-be34-64ce9dd4c22b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:09.585852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27255c77-372a-4413-be34-64ce9dd4c22b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:09.590288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e13b-22c3-4070-b112-d61407329459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:09.590937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e13b-22c3-4070-b112-d61407329459 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.591215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e13b-22c3-4070-b112-d61407329459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.591491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e13b-22c3-4070-b112-d61407329459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.592207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e13b-22c3-4070-b112-d61407329459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:09.593862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-f004e13b-22c3-4070-b112-d61407329459 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:38:09.593862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) May 17 15:38:09.593862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: May 17 15:38:09.594780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e13b-22c3-4070-b112-d61407329459 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:09.607173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 753/1499] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:38:09.611126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e61d-8405-423d-9433-dfb9b105bdd6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:09.620539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e61d-8405-423d-9433-dfb9b105bdd6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:09.624904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57153ed-e832-4636-a564-29931041d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:09.625538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57153ed-e832-4636-a564-29931041d5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.625817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57153ed-e832-4636-a564-29931041d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.626121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57153ed-e832-4636-a564-29931041d5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.626835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57153ed-e832-4636-a564-29931041d5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:09.627818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-c57153ed-e832-4636-a564-29931041d5fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:38:09.627818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) May 17 15:38:09.627818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: May 17 15:38:09.628680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57153ed-e832-4636-a564-29931041d5fd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:09.641877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 747/1500] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:38:09.645800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e13b-22c3-4070-b112-d61407329459 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:09.656009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e13b-22c3-4070-b112-d61407329459 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:09.660534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04636e-7d86-4ab7-9f1a-d3afd16ab2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:09.661400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04636e-7d86-4ab7-9f1a-d3afd16ab2da admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.661679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04636e-7d86-4ab7-9f1a-d3afd16ab2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.661951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04636e-7d86-4ab7-9f1a-d3afd16ab2da admin admin] PATH_INFO: `/v3/projects/4572bc9e15bb42f791b2dd9295a25896/users/9188cbdba75a4d46a224c9234e07a021/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.678288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04636e-7d86-4ab7-9f1a-d3afd16ab2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4572bc9e15bb42f791b2dd9295a25896, user_id=9188cbdba75a4d46a224c9234e07a021, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:09.679602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-ad04636e-7d86-4ab7-9f1a-d3afd16ab2da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:38:09.679602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) May 17 15:38:09.679602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: May 17 15:38:09.682262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04636e-7d86-4ab7-9f1a-d3afd16ab2da admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:09.695619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 754/1501] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:38:09 2022] PUT /identity/v3/projects/4572bc9e15bb42f791b2dd9295a25896/users/9188cbdba75a4d46a224c9234e07a021/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:38:09.707217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1281d-c4b8-4b2d-ac13-56d555e2dd68 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.707503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1281d-c4b8-4b2d-ac13-56d555e2dd68 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.707780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1281d-c4b8-4b2d-ac13-56d555e2dd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.732897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-51d1281d-c4b8-4b2d-ac13-56d555e2dd68 None None] MFA Rules not processed for user `9188cbdba75a4d46a224c9234e07a021`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:38:09.734642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-51d1281d-c4b8-4b2d-ac13-56d555e2dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:38:09.799544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 748/1502] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:38:09.812735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553d9ed-7693-4790-80a1-97bebf4cbb9b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.813026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553d9ed-7693-4790-80a1-97bebf4cbb9b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.813306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553d9ed-7693-4790-80a1-97bebf4cbb9b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.814754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 755/1503] 10.222.0.75 () {54 vars in 963 bytes} [Tue May 17 15:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:38:09.819524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508647-253b-480d-a7f6-3ba288a1ca56 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.819818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508647-253b-480d-a7f6-3ba288a1ca56 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.820094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508647-253b-480d-a7f6-3ba288a1ca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.837186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c2508647-253b-480d-a7f6-3ba288a1ca56 None None] MFA Rules not processed for user `3196743ff7564c16b3cfdae4f0008075`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:38:09.838450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c2508647-253b-480d-a7f6-3ba288a1ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:38:09.887464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 749/1504] 10.222.0.75 () {58 vars in 1060 bytes} [Tue May 17 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:38:09.895496 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553d9ed-7693-4790-80a1-97bebf4cbb9b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:09.905613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553d9ed-7693-4790-80a1-97bebf4cbb9b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:09.909142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f9303-5207-4b62-a40f-f90cb0e76f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:09.909707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f9303-5207-4b62-a40f-f90cb0e76f3e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.909988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f9303-5207-4b62-a40f-f90cb0e76f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.910303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f9303-5207-4b62-a40f-f90cb0e76f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.918185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f9303-5207-4b62-a40f-f90cb0e76f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:09.919602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f9303-5207-4b62-a40f-f90cb0e76f3e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:09.928023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 756/1505] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:38:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:38:09.969767 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a2663-0e55-4d64-867f-8cd5b21c6e68 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:09.970093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a2663-0e55-4d64-867f-8cd5b21c6e68 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:09.970370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a2663-0e55-4d64-867f-8cd5b21c6e68 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:09.971644 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 750/1506] 10.222.0.75 () {52 vars in 829 bytes} [Tue May 17 15:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:38:09.975433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f9303-5207-4b62-a40f-f90cb0e76f3e service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:10.034764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f9303-5207-4b62-a40f-f90cb0e76f3e service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:10.039159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:10.040014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:10.040290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:10.040591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] PATH_INFO: `/v3/users/9188cbdba75a4d46a224c9234e07a021` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:10.041772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9188cbdba75a4d46a224c9234e07a021)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:10.042831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:38:10.042831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) May 17 15:38:10.042831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: May 17 15:38:10.044028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:10.105762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9188cbdba75a4d46a224c9234e07a021'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.131135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9188cbdba75a4d46a224c9234e07a021'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.131824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9188cbdba75a4d46a224c9234e07a021'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.132539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9188cbdba75a4d46a224c9234e07a021'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.145860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9188cbdba75a4d46a224c9234e07a021'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.159553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 757/1507] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:38:09 2022] DELETE /identity/v3/users/9188cbdba75a4d46a224c9234e07a021 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:38:10.163913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9a9ed-f03f-4014-89c2-7520981510f3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:10.164193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9a9ed-f03f-4014-89c2-7520981510f3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:10.164465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9a9ed-f03f-4014-89c2-7520981510f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:10.181805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c3c9a9ed-f03f-4014-89c2-7520981510f3 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:38:10.183042 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c3c9a9ed-f03f-4014-89c2-7520981510f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:38:10.239282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 751/1508] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:38:10.249919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:10.251357 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:38:10.308015 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f4763-2559-46da-855f-eb22b7fd3701 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:10.312175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3f6bb-35a9-4255-adc3-71a5f943a31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:10.312822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3f6bb-35a9-4255-adc3-71a5f943a31a service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:10.313119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3f6bb-35a9-4255-adc3-71a5f943a31a service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:10.313403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3f6bb-35a9-4255-adc3-71a5f943a31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:10.322279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3f6bb-35a9-4255-adc3-71a5f943a31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:10.323744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3f6bb-35a9-4255-adc3-71a5f943a31a service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:10.332743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 758/1509] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:38:10.650141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9a9ed-f03f-4014-89c2-7520981510f3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:38:10.651625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c3c9a9ed-f03f-4014-89c2-7520981510f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:38:10.663685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9a9ed-f03f-4014-89c2-7520981510f3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:38:10.668280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:38:10.669129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:38:10.669421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:38:10.669695 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] PATH_INFO: `/v3/projects/4572bc9e15bb42f791b2dd9295a25896` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:38:10.671634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4572bc9e15bb42f791b2dd9295a25896)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:38:10.672554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:38:10.672554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) May 17 15:38:10.672554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: May 17 15:38:10.674389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:38:10.732455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4572bc9e15bb42f791b2dd9295a25896', 'request_id': 'req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.747504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4572bc9e15bb42f791b2dd9295a25896', 'request_id': 'req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.757296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4572bc9e15bb42f791b2dd9295a25896', 'request_id': 'req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.767985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] The token cache is being invalidate because project 4572bc9e15bb42f791b2dd9295a25896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:38:10.768270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.768880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8863c14d-f6d1-41d7-9b43-bf03e7e4348f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:38:10.770577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 752/1510] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:38:10 2022] DELETE /identity/v3/projects/4572bc9e15bb42f791b2dd9295a25896 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:39:52.067172 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccc060-ac02-4cf0-a90e-31e3f5d46fe3 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:52.067778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccc060-ac02-4cf0-a90e-31e3f5d46fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:52.067778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccc060-ac02-4cf0-a90e-31e3f5d46fe3 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:52.069146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:39:52.074125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a2a04-0dc1-4950-aaeb-9cf794af08a0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:52.074555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a2a04-0dc1-4950-aaeb-9cf794af08a0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:52.074690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a2a04-0dc1-4950-aaeb-9cf794af08a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:52.092384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-787a2a04-0dc1-4950-aaeb-9cf794af08a0 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:39:52.093587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-787a2a04-0dc1-4950-aaeb-9cf794af08a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:39:52.149422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:39:52.323163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccc060-ac02-4cf0-a90e-31e3f5d46fe3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:39:52.324758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-67ccc060-ac02-4cf0-a90e-31e3f5d46fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:39:52.395583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccc060-ac02-4cf0-a90e-31e3f5d46fe3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:39:52.400939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39690d37-e3a1-436d-8afa-6d2d4017460f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:39:52.401572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39690d37-e3a1-436d-8afa-6d2d4017460f service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:52.401853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39690d37-e3a1-436d-8afa-6d2d4017460f service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:52.402163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39690d37-e3a1-436d-8afa-6d2d4017460f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:52.410476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39690d37-e3a1-436d-8afa-6d2d4017460f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:39:52.412053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39690d37-e3a1-436d-8afa-6d2d4017460f service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:39:52.421624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 760/1513] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:39:53.337126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc35c6-ed64-4842-bf19-7b9473f6270c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:53.337717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc35c6-ed64-4842-bf19-7b9473f6270c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:53.337717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc35c6-ed64-4842-bf19-7b9473f6270c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:53.339098 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:39:53.343917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45725df-377b-40e3-85b5-87da4207e1c4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:53.344345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45725df-377b-40e3-85b5-87da4207e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:53.344482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45725df-377b-40e3-85b5-87da4207e1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:53.362827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d45725df-377b-40e3-85b5-87da4207e1c4 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:39:53.364013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d45725df-377b-40e3-85b5-87da4207e1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:39:53.371775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:39:53.521271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc35c6-ed64-4842-bf19-7b9473f6270c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:39:53.535548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc35c6-ed64-4842-bf19-7b9473f6270c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:39:53.541105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c07bf-3886-4265-a73c-f503f1a03e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:39:53.541733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c07bf-3886-4265-a73c-f503f1a03e03 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:53.542025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c07bf-3886-4265-a73c-f503f1a03e03 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:53.542316 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c07bf-3886-4265-a73c-f503f1a03e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:53.550735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c07bf-3886-4265-a73c-f503f1a03e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:39:53.552301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c07bf-3886-4265-a73c-f503f1a03e03 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:39:53.561894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 755/1516] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:39:54.011149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fad48-2d68-4a02-8c63-155c8bc70ab7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:54.011438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fad48-2d68-4a02-8c63-155c8bc70ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:54.011719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fad48-2d68-4a02-8c63-155c8bc70ab7 None None] PATH_INFO: `/v3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:54.013691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 762/1517] 10.222.0.61 () {54 vars in 925 bytes} [Tue May 17 15:39:54 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:39:54.020464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff07559-a3b4-441d-8e70-6581a4e8b3c7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:54.020757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff07559-a3b4-441d-8e70-6581a4e8b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:54.021034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff07559-a3b4-441d-8e70-6581a4e8b3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:54.038574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8ff07559-a3b4-441d-8e70-6581a4e8b3c7 None None] MFA Rules not processed for user `8614649160fb4bcca89b18ceeb6c0785`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:39:54.039773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8ff07559-a3b4-441d-8e70-6581a4e8b3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:39:54.098336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 756/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Tue May 17 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:39:58.003118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7af87-9759-4588-be1a-ed03dcbb55dd None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:58.003677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7af87-9759-4588-be1a-ed03dcbb55dd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:58.003677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7af87-9759-4588-be1a-ed03dcbb55dd None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:58.004915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 763/1519] 10.222.0.75 () {54 vars in 960 bytes} [Tue May 17 15:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:39:58.010316 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d470e6-6e58-4c3b-919c-41272602ff0a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:58.010739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d470e6-6e58-4c3b-919c-41272602ff0a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:58.010910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d470e6-6e58-4c3b-919c-41272602ff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:58.029357 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-36d470e6-6e58-4c3b-919c-41272602ff0a None None] MFA Rules not processed for user `8614649160fb4bcca89b18ceeb6c0785`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:39:58.030570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-36d470e6-6e58-4c3b-919c-41272602ff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:39:58.038752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 757/1520] 10.222.0.75 () {58 vars in 1057 bytes} [Tue May 17 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:39:58.046058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7af87-9759-4588-be1a-ed03dcbb55dd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:39:58.058776 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7af87-9759-4588-be1a-ed03dcbb55dd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:39:58.063594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397701b-e65a-4837-a9cc-1d4ce477d9ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:39:58.064211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397701b-e65a-4837-a9cc-1d4ce477d9ab service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:39:58.064492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397701b-e65a-4837-a9cc-1d4ce477d9ab service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:39:58.064765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397701b-e65a-4837-a9cc-1d4ce477d9ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:39:58.072707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397701b-e65a-4837-a9cc-1d4ce477d9ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:39:58.074321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397701b-e65a-4837-a9cc-1d4ce477d9ab service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:39:58.084480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 764/1521] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:40:04.855580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3faf74-d089-4bec-9f06-146ed0114f78 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:04.856174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3faf74-d089-4bec-9f06-146ed0114f78 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:04.856174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3faf74-d089-4bec-9f06-146ed0114f78 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:04.857502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:40:04.862318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42760ca1-e8b2-47a1-be93-07542625e6c5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:04.862764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42760ca1-e8b2-47a1-be93-07542625e6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:04.862870 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42760ca1-e8b2-47a1-be93-07542625e6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:04.881024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-42760ca1-e8b2-47a1-be93-07542625e6c5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:40:04.882257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-42760ca1-e8b2-47a1-be93-07542625e6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:04.890539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:40:05.040455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3faf74-d089-4bec-9f06-146ed0114f78 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:40:05.054340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3faf74-d089-4bec-9f06-146ed0114f78 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:40:05.060116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6458b0-47d7-4b9d-b4d6-40b5052e28e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:40:05.060739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6458b0-47d7-4b9d-b4d6-40b5052e28e6 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:05.061016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6458b0-47d7-4b9d-b4d6-40b5052e28e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:05.061287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6458b0-47d7-4b9d-b4d6-40b5052e28e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:05.068998 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6458b0-47d7-4b9d-b4d6-40b5052e28e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:40:05.070593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6458b0-47d7-4b9d-b4d6-40b5052e28e6 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:40:05.080162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 759/1524] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:40:05.962483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34352dd0-4e5b-4ee4-aba0-20a0941da43d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:05.962899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34352dd0-4e5b-4ee4-aba0-20a0941da43d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:05.963178 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34352dd0-4e5b-4ee4-aba0-20a0941da43d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:05.964405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 15:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 15:40:05.970046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1601ea6-688d-4648-91fe-630fa467f221 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:05.970535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1601ea6-688d-4648-91fe-630fa467f221 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:05.970615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1601ea6-688d-4648-91fe-630fa467f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:05.989461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c1601ea6-688d-4648-91fe-630fa467f221 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:40:05.990689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c1601ea6-688d-4648-91fe-630fa467f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:05.998462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 15:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:40:06.147503 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34352dd0-4e5b-4ee4-aba0-20a0941da43d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:40:06.162106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34352dd0-4e5b-4ee4-aba0-20a0941da43d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:40:06.167449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bee8bd-68b7-4273-be9c-414e0a8ee409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:40:06.168074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bee8bd-68b7-4273-be9c-414e0a8ee409 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:06.168356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bee8bd-68b7-4273-be9c-414e0a8ee409 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:06.168632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bee8bd-68b7-4273-be9c-414e0a8ee409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:06.176495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bee8bd-68b7-4273-be9c-414e0a8ee409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:40:06.178105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bee8bd-68b7-4273-be9c-414e0a8ee409 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:40:06.187203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 767/1527] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:40:10.237642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc037a1-fb3e-4f20-9f4f-290b30292408 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:10.238199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc037a1-fb3e-4f20-9f4f-290b30292408 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:10.238327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc037a1-fb3e-4f20-9f4f-290b30292408 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:10.239652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:40:10.244610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd221534-8d57-487c-ae0d-030c11bad436 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:10.245019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd221534-8d57-487c-ae0d-030c11bad436 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:10.245161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd221534-8d57-487c-ae0d-030c11bad436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:10.263439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cd221534-8d57-487c-ae0d-030c11bad436 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:40:10.264614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cd221534-8d57-487c-ae0d-030c11bad436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:10.272488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:40:10.308187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc037a1-fb3e-4f20-9f4f-290b30292408 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:40:10.310455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5fc037a1-fb3e-4f20-9f4f-290b30292408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:10.365529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc037a1-fb3e-4f20-9f4f-290b30292408 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:40:10.369199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841b6e2-529b-4899-ae3a-bd50a77f7b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:40:10.369836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841b6e2-529b-4899-ae3a-bd50a77f7b8b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:10.370155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841b6e2-529b-4899-ae3a-bd50a77f7b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:10.370466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841b6e2-529b-4899-ae3a-bd50a77f7b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:10.379734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841b6e2-529b-4899-ae3a-bd50a77f7b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:40:10.381151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841b6e2-529b-4899-ae3a-bd50a77f7b8b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:40:10.390942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 762/1530] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:40:12.562910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74140a-1ee4-4422-bde5-53df2c6e1176 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:12.563420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74140a-1ee4-4422-bde5-53df2c6e1176 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:12.563420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74140a-1ee4-4422-bde5-53df2c6e1176 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:12.564750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:40:12.569794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e55c85-ea55-4cbe-8fa7-6bf605691882 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:12.570219 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e55c85-ea55-4cbe-8fa7-6bf605691882 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:12.570388 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e55c85-ea55-4cbe-8fa7-6bf605691882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:12.587920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f9e55c85-ea55-4cbe-8fa7-6bf605691882 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:40:12.589122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f9e55c85-ea55-4cbe-8fa7-6bf605691882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:12.597280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:40:12.632890 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74140a-1ee4-4422-bde5-53df2c6e1176 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:40:12.634622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4c74140a-1ee4-4422-bde5-53df2c6e1176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:12.647544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74140a-1ee4-4422-bde5-53df2c6e1176 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:40:12.651101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127047cb-49ce-43db-a2dd-70aefc5bfb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:40:12.651756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127047cb-49ce-43db-a2dd-70aefc5bfb6d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:12.652041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127047cb-49ce-43db-a2dd-70aefc5bfb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:12.652317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127047cb-49ce-43db-a2dd-70aefc5bfb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:12.661822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127047cb-49ce-43db-a2dd-70aefc5bfb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:40:12.663298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127047cb-49ce-43db-a2dd-70aefc5bfb6d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:40:12.673109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 770/1533] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:40:16.419548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef662-125b-4393-9b50-94598ba73a8c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:16.420110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef662-125b-4393-9b50-94598ba73a8c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:16.420110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef662-125b-4393-9b50-94598ba73a8c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:16.421437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:40:16.426638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9d72-2b74-438c-a61c-615f0f0408d9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:16.427089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9d72-2b74-438c-a61c-615f0f0408d9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:16.427207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9d72-2b74-438c-a61c-615f0f0408d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:16.444756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f5cc9d72-2b74-438c-a61c-615f0f0408d9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:40:16.445963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f5cc9d72-2b74-438c-a61c-615f0f0408d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:16.453811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:40:16.728106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef662-125b-4393-9b50-94598ba73a8c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:40:16.729786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fa4ef662-125b-4393-9b50-94598ba73a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:16.785801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef662-125b-4393-9b50-94598ba73a8c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:40:16.789289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6748-bd78-4ff3-93eb-fb972fe82660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:40:16.789917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6748-bd78-4ff3-93eb-fb972fe82660 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:16.790223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6748-bd78-4ff3-93eb-fb972fe82660 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:16.790494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6748-bd78-4ff3-93eb-fb972fe82660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:16.799554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6748-bd78-4ff3-93eb-fb972fe82660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:40:16.800955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6748-bd78-4ff3-93eb-fb972fe82660 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:40:16.810648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 765/1536] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:40:19.049866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7f0f-79d9-4597-9f02-c6bfca1b4743 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:19.050466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7f0f-79d9-4597-9f02-c6bfca1b4743 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:19.050466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7f0f-79d9-4597-9f02-c6bfca1b4743 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:19.051811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 15:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:40:19.057144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045db0a-fb25-4372-90b8-efd833b76e7c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:19.057577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045db0a-fb25-4372-90b8-efd833b76e7c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:19.057709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045db0a-fb25-4372-90b8-efd833b76e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:19.081532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1045db0a-fb25-4372-90b8-efd833b76e7c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:40:19.082778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1045db0a-fb25-4372-90b8-efd833b76e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:19.091446 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:40:19.360966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a7f0f-79d9-4597-9f02-c6bfca1b4743 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:40:19.362669 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9a9a7f0f-79d9-4597-9f02-c6bfca1b4743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:40:19.376050 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a7f0f-79d9-4597-9f02-c6bfca1b4743 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:40:19.379692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eda49-5fba-4988-9972-980ba79a8eb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:40:19.380321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eda49-5fba-4988-9972-980ba79a8eb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:40:19.380643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eda49-5fba-4988-9972-980ba79a8eb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:40:19.380920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eda49-5fba-4988-9972-980ba79a8eb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:40:19.390386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eda49-5fba-4988-9972-980ba79a8eb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:40:19.391817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eda49-5fba-4988-9972-980ba79a8eb8 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:40:19.401095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 773/1539] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:48.472849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282df26-9f25-4894-b28b-627cd3f36c5d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.473438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282df26-9f25-4894-b28b-627cd3f36c5d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.473438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282df26-9f25-4894-b28b-627cd3f36c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.514602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4282df26-9f25-4894-b28b-627cd3f36c5d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.515940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4282df26-9f25-4894-b28b-627cd3f36c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.528368 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 767/1540] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.539613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b432c-d639-4e21-84da-3422003a660a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.540929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b432c-d639-4e21-84da-3422003a660a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.541523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b432c-d639-4e21-84da-3422003a660a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.578021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d61b432c-d639-4e21-84da-3422003a660a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.579706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d61b432c-d639-4e21-84da-3422003a660a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.594173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7a452-692b-402f-960b-9f305d52856b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.594858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7a452-692b-402f-960b-9f305d52856b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.595364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7a452-692b-402f-960b-9f305d52856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.595554 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 774/1541] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.596895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9e5f-c27b-4080-9417-50514837f323 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.597414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9e5f-c27b-4080-9417-50514837f323 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.597700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9e5f-c27b-4080-9417-50514837f323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.626440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-16c7a452-692b-402f-960b-9f305d52856b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.628337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6eee9e5f-c27b-4080-9417-50514837f323 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.629517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6eee9e5f-c27b-4080-9417-50514837f323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.630699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-16c7a452-692b-402f-960b-9f305d52856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.646097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 775/1542] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.646509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 768/1543] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:41:48.647556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9e5f-c27b-4080-9417-50514837f323 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:48.648020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6bd3c-ec2d-4b2b-812a-a6d70457fa94 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.648314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6bd3c-ec2d-4b2b-812a-a6d70457fa94 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.648619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6bd3c-ec2d-4b2b-812a-a6d70457fa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.668530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9e5f-c27b-4080-9417-50514837f323 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:48.688749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d8412-6d4c-46ac-90d1-c1d40ef36c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:48.689435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d8412-6d4c-46ac-90d1-c1d40ef36c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.689555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3ae6bd3c-ec2d-4b2b-812a-a6d70457fa94 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.689735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d8412-6d4c-46ac-90d1-c1d40ef36c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.689988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d8412-6d4c-46ac-90d1-c1d40ef36c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.690716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3ae6bd3c-ec2d-4b2b-812a-a6d70457fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.690843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d8412-6d4c-46ac-90d1-c1d40ef36c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:48.691014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d8412-6d4c-46ac-90d1-c1d40ef36c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:48.692032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-a26d8412-6d4c-46ac-90d1-c1d40ef36c42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:41:48.692032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) May 17 15:41:48.692032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: May 17 15:41:48.692921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d8412-6d4c-46ac-90d1-c1d40ef36c42 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:48.716409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 769/1544] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.717753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c6d97-fcd7-4176-b4b2-9ed159e4c0d2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.718365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c6d97-fcd7-4176-b4b2-9ed159e4c0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.719381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c6d97-fcd7-4176-b4b2-9ed159e4c0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.720570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 776/1545] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:48.721883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32430156-8b33-4798-b266-746942cd4b56 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.722194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32430156-8b33-4798-b266-746942cd4b56 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.722471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32430156-8b33-4798-b266-746942cd4b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.758175 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e76c6d97-fcd7-4176-b4b2-9ed159e4c0d2 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.759513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e76c6d97-fcd7-4176-b4b2-9ed159e4c0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.765401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-32430156-8b33-4798-b266-746942cd4b56 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.767017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-32430156-8b33-4798-b266-746942cd4b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.772604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 770/1546] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.774180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c07994-0ede-4ef7-822f-9e7a0200e439 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.774472 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c07994-0ede-4ef7-822f-9e7a0200e439 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.774752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c07994-0ede-4ef7-822f-9e7a0200e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.777469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 777/1547] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.778265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32430156-8b33-4798-b266-746942cd4b56 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:48.790931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32430156-8b33-4798-b266-746942cd4b56 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:48.794663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a2c07994-0ede-4ef7-822f-9e7a0200e439 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.795854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a2c07994-0ede-4ef7-822f-9e7a0200e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.796111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81acd34-13ef-4ed0-b0f4-80c8f676e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:48.796763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81acd34-13ef-4ed0-b0f4-80c8f676e9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.797048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81acd34-13ef-4ed0-b0f4-80c8f676e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.797352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81acd34-13ef-4ed0-b0f4-80c8f676e9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.798059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81acd34-13ef-4ed0-b0f4-80c8f676e9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:48.799958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81acd34-13ef-4ed0-b0f4-80c8f676e9c8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:48.804184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 771/1548] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.805416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc2b90-d4e2-4b62-a04f-9ba1328a9ce4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.805705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc2b90-d4e2-4b62-a04f-9ba1328a9ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.805986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc2b90-d4e2-4b62-a04f-9ba1328a9ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.831679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 778/1549] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:48.833796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1a70-db04-4784-89a0-036d92f7d44e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.834103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-49dc2b90-d4e2-4b62-a04f-9ba1328a9ce4 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.834583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1a70-db04-4784-89a0-036d92f7d44e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.835212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1a70-db04-4784-89a0-036d92f7d44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.835346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-49dc2b90-d4e2-4b62-a04f-9ba1328a9ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.859266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-641d1a70-db04-4784-89a0-036d92f7d44e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.860453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-641d1a70-db04-4784-89a0-036d92f7d44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.894252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 772/1550] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.895369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1020a-8b71-4d44-8b54-e151bfade4cb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.895664 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1020a-8b71-4d44-8b54-e151bfade4cb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.895943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1020a-8b71-4d44-8b54-e151bfade4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.913632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c7a1020a-8b71-4d44-8b54-e151bfade4cb None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.914971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c7a1020a-8b71-4d44-8b54-e151bfade4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.916249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 779/1551] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.917607 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1a70-db04-4784-89a0-036d92f7d44e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:48.928039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 773/1552] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.928887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1020a-8b71-4d44-8b54-e151bfade4cb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:48.929015 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1a70-db04-4784-89a0-036d92f7d44e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:48.937210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35be1a6-7511-4768-a150-5e25b8287381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:48.938063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35be1a6-7511-4768-a150-5e25b8287381 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.938478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35be1a6-7511-4768-a150-5e25b8287381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.939126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35be1a6-7511-4768-a150-5e25b8287381 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.939971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35be1a6-7511-4768-a150-5e25b8287381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:48.940281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35be1a6-7511-4768-a150-5e25b8287381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:48.941898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35be1a6-7511-4768-a150-5e25b8287381 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:48.942931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1020a-8b71-4d44-8b54-e151bfade4cb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:48.947469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea927-9849-4e65-87a1-3b3e5da8a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:48.948142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea927-9849-4e65-87a1-3b3e5da8a0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.948427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea927-9849-4e65-87a1-3b3e5da8a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.948703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea927-9849-4e65-87a1-3b3e5da8a0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.949426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ea927-9849-4e65-87a1-3b3e5da8a0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:48.949732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ea927-9849-4e65-87a1-3b3e5da8a0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:48.951357 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ea927-9849-4e65-87a1-3b3e5da8a0d9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:48.953652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 780/1553] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:48.954938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d26209-ac95-4459-b15d-bd221d7d09b4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.955226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d26209-ac95-4459-b15d-bd221d7d09b4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.955531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d26209-ac95-4459-b15d-bd221d7d09b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.970022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 774/1554] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:48.970778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea927-9849-4e65-87a1-3b3e5da8a0d9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:48.974497 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-70d26209-ac95-4459-b15d-bd221d7d09b4 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:48.975732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-70d26209-ac95-4459-b15d-bd221d7d09b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:48.984371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea927-9849-4e65-87a1-3b3e5da8a0d9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:48.988797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 781/1555] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:48.988929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb72bfa-a5d2-44c3-a213-6d6c99d0e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:48.989662 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb72bfa-a5d2-44c3-a213-6d6c99d0e0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.989945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb72bfa-a5d2-44c3-a213-6d6c99d0e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.990251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb72bfa-a5d2-44c3-a213-6d6c99d0e0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:48.990939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb72bfa-a5d2-44c3-a213-6d6c99d0e0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:48.993205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb72bfa-a5d2-44c3-a213-6d6c99d0e0b6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:48.993958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3946-f77e-4e91-8612-9c38adbe7dbe None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:48.994420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3946-f77e-4e91-8612-9c38adbe7dbe None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:48.995408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3946-f77e-4e91-8612-9c38adbe7dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.013965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-754e3946-f77e-4e91-8612-9c38adbe7dbe None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:49.014560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 775/1556] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.015134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-754e3946-f77e-4e91-8612-9c38adbe7dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:49.015411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb72bfa-a5d2-44c3-a213-6d6c99d0e0b6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.023171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 782/1557] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:49.024376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48819-dd0d-4400-9d73-f85bdbb701a0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.024671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48819-dd0d-4400-9d73-f85bdbb701a0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.024912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb72bfa-a5d2-44c3-a213-6d6c99d0e0b6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.025032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48819-dd0d-4400-9d73-f85bdbb701a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.029533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588287b2-d67f-425e-8fb9-05f86d3b24df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.030294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588287b2-d67f-425e-8fb9-05f86d3b24df admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.030623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588287b2-d67f-425e-8fb9-05f86d3b24df admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.030992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588287b2-d67f-425e-8fb9-05f86d3b24df admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.031723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588287b2-d67f-425e-8fb9-05f86d3b24df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:49.032028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588287b2-d67f-425e-8fb9-05f86d3b24df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.033625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588287b2-d67f-425e-8fb9-05f86d3b24df admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.043450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-88a48819-dd0d-4400-9d73-f85bdbb701a0 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:49.044650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-88a48819-dd0d-4400-9d73-f85bdbb701a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:49.046077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 776/1558] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:49.047372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d4769-4f5b-41c0-be24-9b4a19894428 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.047711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d4769-4f5b-41c0-be24-9b4a19894428 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.047938 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d4769-4f5b-41c0-be24-9b4a19894428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.056280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 783/1559] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:49.056280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48819-dd0d-4400-9d73-f85bdbb701a0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.063894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48819-dd0d-4400-9d73-f85bdbb701a0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.068538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9b7d4769-4f5b-41c0-be24-9b4a19894428 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:49.068682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a394d5e-484c-4dd6-a3b9-b11a55b151cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.069225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a394d5e-484c-4dd6-a3b9-b11a55b151cb admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.069500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a394d5e-484c-4dd6-a3b9-b11a55b151cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.069768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a394d5e-484c-4dd6-a3b9-b11a55b151cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.069872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b7d4769-4f5b-41c0-be24-9b4a19894428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:49.070470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a394d5e-484c-4dd6-a3b9-b11a55b151cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.072364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a394d5e-484c-4dd6-a3b9-b11a55b151cb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.077631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 777/1560] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:49.078458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d4769-4f5b-41c0-be24-9b4a19894428 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.087506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d4769-4f5b-41c0-be24-9b4a19894428 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.092581 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bda58-3084-4b3a-aaca-d5bc38690531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.093221 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bda58-3084-4b3a-aaca-d5bc38690531 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.093507 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bda58-3084-4b3a-aaca-d5bc38690531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.093781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bda58-3084-4b3a-aaca-d5bc38690531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.094514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bda58-3084-4b3a-aaca-d5bc38690531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.095522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-4a1bda58-3084-4b3a-aaca-d5bc38690531 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:41:49.095522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) May 17 15:41:49.095522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: May 17 15:41:49.096706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bda58-3084-4b3a-aaca-d5bc38690531 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.096947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 784/1561] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.097746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a394d5e-484c-4dd6-a3b9-b11a55b151cb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.126358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 778/1562] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.126358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bda58-3084-4b3a-aaca-d5bc38690531 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.161516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a394d5e-484c-4dd6-a3b9-b11a55b151cb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.182797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bda58-3084-4b3a-aaca-d5bc38690531 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.187332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd4569-886c-47dd-81be-2f9e36a1dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.187996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd4569-886c-47dd-81be-2f9e36a1dc1c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.188278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd4569-886c-47dd-81be-2f9e36a1dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.188556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd4569-886c-47dd-81be-2f9e36a1dc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.189273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd4569-886c-47dd-81be-2f9e36a1dc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.190917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd4569-886c-47dd-81be-2f9e36a1dc1c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.200402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 779/1563] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:49.201943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e497e-d3ae-4998-8e33-91021aa0f7f0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.202265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e497e-d3ae-4998-8e33-91021aa0f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.202550 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e497e-d3ae-4998-8e33-91021aa0f7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.216409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595f529-984a-44da-8326-3fd857f6d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.217067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595f529-984a-44da-8326-3fd857f6d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.217347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595f529-984a-44da-8326-3fd857f6d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.217620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595f529-984a-44da-8326-3fd857f6d9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.218370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595f529-984a-44da-8326-3fd857f6d9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:49.218670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595f529-984a-44da-8326-3fd857f6d9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.220152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a43e497e-d3ae-4998-8e33-91021aa0f7f0 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:49.220272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595f529-984a-44da-8326-3fd857f6d9e5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.221399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a43e497e-d3ae-4998-8e33-91021aa0f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:49.231288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 780/1564] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:49.231288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e497e-d3ae-4998-8e33-91021aa0f7f0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.236517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 785/1565] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:49.237706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595f529-984a-44da-8326-3fd857f6d9e5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.242902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e497e-d3ae-4998-8e33-91021aa0f7f0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.247310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595f529-984a-44da-8326-3fd857f6d9e5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.247644 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23532b14-639e-4599-b826-5e3c6842801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.248351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23532b14-639e-4599-b826-5e3c6842801d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.248642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23532b14-639e-4599-b826-5e3c6842801d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.248922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23532b14-639e-4599-b826-5e3c6842801d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.249634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23532b14-639e-4599-b826-5e3c6842801d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.251609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23532b14-639e-4599-b826-5e3c6842801d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.251943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf501f-5a1a-4ff3-8907-21be562dc809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.252582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf501f-5a1a-4ff3-8907-21be562dc809 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.252864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf501f-5a1a-4ff3-8907-21be562dc809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.253139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf501f-5a1a-4ff3-8907-21be562dc809 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.253851 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf501f-5a1a-4ff3-8907-21be562dc809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:49.254188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf501f-5a1a-4ff3-8907-21be562dc809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.255774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf501f-5a1a-4ff3-8907-21be562dc809 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.268250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 786/1566] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:49.269260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf501f-5a1a-4ff3-8907-21be562dc809 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.281086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 781/1567] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.282389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23532b14-639e-4599-b826-5e3c6842801d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.287827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf501f-5a1a-4ff3-8907-21be562dc809 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.341674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defe9d7-2824-4644-9fe7-998eb41ec7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.342379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defe9d7-2824-4644-9fe7-998eb41ec7db admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.342520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23532b14-639e-4599-b826-5e3c6842801d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.342658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defe9d7-2824-4644-9fe7-998eb41ec7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.343056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defe9d7-2824-4644-9fe7-998eb41ec7db admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.343764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defe9d7-2824-4644-9fe7-998eb41ec7db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:49.344066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defe9d7-2824-4644-9fe7-998eb41ec7db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.345808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defe9d7-2824-4644-9fe7-998eb41ec7db admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.347086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a698c9-2979-4bc8-9768-179d052903ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.347742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a698c9-2979-4bc8-9768-179d052903ba admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.348029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a698c9-2979-4bc8-9768-179d052903ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.348304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a698c9-2979-4bc8-9768-179d052903ba admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.348988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a698c9-2979-4bc8-9768-179d052903ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.350940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a698c9-2979-4bc8-9768-179d052903ba admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.358017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 787/1568] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:49.358787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defe9d7-2824-4644-9fe7-998eb41ec7db admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.370200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defe9d7-2824-4644-9fe7-998eb41ec7db admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.373084 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 782/1569] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.374714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40175166-fc4f-49b2-ad92-eb3b6f5f7242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.375378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40175166-fc4f-49b2-ad92-eb3b6f5f7242 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.375637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40175166-fc4f-49b2-ad92-eb3b6f5f7242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.375908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40175166-fc4f-49b2-ad92-eb3b6f5f7242 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.376574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40175166-fc4f-49b2-ad92-eb3b6f5f7242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.376952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a698c9-2979-4bc8-9768-179d052903ba admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.377582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-40175166-fc4f-49b2-ad92-eb3b6f5f7242 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:41:49.377582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) May 17 15:41:49.377582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: May 17 15:41:49.378801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40175166-fc4f-49b2-ad92-eb3b6f5f7242 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.386251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a698c9-2979-4bc8-9768-179d052903ba admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.391283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660938fd-1c25-4a38-a77f-1d294014f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.391982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660938fd-1c25-4a38-a77f-1d294014f0be admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.392293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660938fd-1c25-4a38-a77f-1d294014f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.392563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660938fd-1c25-4a38-a77f-1d294014f0be admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.393328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660938fd-1c25-4a38-a77f-1d294014f0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.394962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660938fd-1c25-4a38-a77f-1d294014f0be admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.401566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 788/1570] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.401566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40175166-fc4f-49b2-ad92-eb3b6f5f7242 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.407288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 783/1571] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:49.408136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660938fd-1c25-4a38-a77f-1d294014f0be admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.409012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40175166-fc4f-49b2-ad92-eb3b6f5f7242 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.413917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a18b2a-dd49-4597-945c-4688e8859b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.414584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a18b2a-dd49-4597-945c-4688e8859b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.414866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a18b2a-dd49-4597-945c-4688e8859b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.415140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a18b2a-dd49-4597-945c-4688e8859b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.415859 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a18b2a-dd49-4597-945c-4688e8859b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:49.416163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a18b2a-dd49-4597-945c-4688e8859b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.418460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a18b2a-dd49-4597-945c-4688e8859b6c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.418893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660938fd-1c25-4a38-a77f-1d294014f0be admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.424246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0b053-a1d6-4c9b-9e80-229db879bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.424869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b053-a1d6-4c9b-9e80-229db879bbec admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.425147 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b053-a1d6-4c9b-9e80-229db879bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.425419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b053-a1d6-4c9b-9e80-229db879bbec admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.426123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0b053-a1d6-4c9b-9e80-229db879bbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.428015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0b053-a1d6-4c9b-9e80-229db879bbec admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.431345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 789/1572] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:49.432137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a18b2a-dd49-4597-945c-4688e8859b6c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.441918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a18b2a-dd49-4597-945c-4688e8859b6c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.446837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb75e19-fd1e-4c92-818e-99a6540c024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.447589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb75e19-fd1e-4c92-818e-99a6540c024f admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.448083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb75e19-fd1e-4c92-818e-99a6540c024f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.448510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb75e19-fd1e-4c92-818e-99a6540c024f admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.449185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb75e19-fd1e-4c92-818e-99a6540c024f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.451134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb75e19-fd1e-4c92-818e-99a6540c024f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.458865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 784/1573] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.458865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0b053-a1d6-4c9b-9e80-229db879bbec admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.476708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 790/1574] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.477350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb75e19-fd1e-4c92-818e-99a6540c024f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.519056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0b053-a1d6-4c9b-9e80-229db879bbec admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.537188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb75e19-fd1e-4c92-818e-99a6540c024f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.541953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cf4f3-8d2e-47f7-8339-3569183a1995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.542635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cf4f3-8d2e-47f7-8339-3569183a1995 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.542917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cf4f3-8d2e-47f7-8339-3569183a1995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.543193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cf4f3-8d2e-47f7-8339-3569183a1995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.543870 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cf4f3-8d2e-47f7-8339-3569183a1995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.545858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cf4f3-8d2e-47f7-8339-3569183a1995 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.571845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 791/1575] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.575635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cf4f3-8d2e-47f7-8339-3569183a1995 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.578124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6c60c-826c-41d5-b871-9d8f599bd267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.578863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c60c-826c-41d5-b871-9d8f599bd267 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.579203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c60c-826c-41d5-b871-9d8f599bd267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.579525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c60c-826c-41d5-b871-9d8f599bd267 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.580261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6c60c-826c-41d5-b871-9d8f599bd267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.582303 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6c60c-826c-41d5-b871-9d8f599bd267 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.602884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 785/1576] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.603764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6c60c-826c-41d5-b871-9d8f599bd267 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.613129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6c60c-826c-41d5-b871-9d8f599bd267 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.634200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cf4f3-8d2e-47f7-8339-3569183a1995 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.639382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f37f6-c947-49fc-ae81-e5613336f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.640043 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f37f6-c947-49fc-ae81-e5613336f627 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.640328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f37f6-c947-49fc-ae81-e5613336f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.640605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f37f6-c947-49fc-ae81-e5613336f627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.641340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f37f6-c947-49fc-ae81-e5613336f627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.643418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f37f6-c947-49fc-ae81-e5613336f627 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.653639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 792/1577] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:49.654445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f37f6-c947-49fc-ae81-e5613336f627 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.663480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f37f6-c947-49fc-ae81-e5613336f627 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.668569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3116110-1068-40c5-a8a8-b4da1dfbefb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.669419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116110-1068-40c5-a8a8-b4da1dfbefb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.669703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116110-1068-40c5-a8a8-b4da1dfbefb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.669979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116110-1068-40c5-a8a8-b4da1dfbefb2 admin admin] PATH_INFO: `/v3/projects/87cc0cd3d0df4dccbc28058b6866d076/users/b40c7b11fff443fa8c78e8647703e230/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.670669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58bf93-b64e-4d9f-86f5-67ad9c364019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.671338 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58bf93-b64e-4d9f-86f5-67ad9c364019 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.671640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58bf93-b64e-4d9f-86f5-67ad9c364019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.671902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58bf93-b64e-4d9f-86f5-67ad9c364019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.672631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58bf93-b64e-4d9f-86f5-67ad9c364019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.674266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58bf93-b64e-4d9f-86f5-67ad9c364019 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.684287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 786/1578] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:49.687341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3116110-1068-40c5-a8a8-b4da1dfbefb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cc0cd3d0df4dccbc28058b6866d076, user_id=b40c7b11fff443fa8c78e8647703e230, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.687484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58bf93-b64e-4d9f-86f5-67ad9c364019 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.687872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3116110-1068-40c5-a8a8-b4da1dfbefb2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.695601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58bf93-b64e-4d9f-86f5-67ad9c364019 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.700997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 793/1579] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:49 2022] PUT /identity/v3/projects/87cc0cd3d0df4dccbc28058b6866d076/users/b40c7b11fff443fa8c78e8647703e230/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:49.702023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3116110-1068-40c5-a8a8-b4da1dfbefb2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.753553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e388f3-cb5f-4993-8555-ae64968fd714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.754262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e388f3-cb5f-4993-8555-ae64968fd714 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.754544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e388f3-cb5f-4993-8555-ae64968fd714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.754819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e388f3-cb5f-4993-8555-ae64968fd714 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.755502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e388f3-cb5f-4993-8555-ae64968fd714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.757417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e388f3-cb5f-4993-8555-ae64968fd714 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.760909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3116110-1068-40c5-a8a8-b4da1dfbefb2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.765653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47781-2fb5-48af-bfe5-13f93adfcb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.766435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47781-2fb5-48af-bfe5-13f93adfcb21 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.766898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47781-2fb5-48af-bfe5-13f93adfcb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.767355 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47781-2fb5-48af-bfe5-13f93adfcb21 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.768505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd47781-2fb5-48af-bfe5-13f93adfcb21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.771886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd47781-2fb5-48af-bfe5-13f93adfcb21 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.783748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 787/1580] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.784618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e388f3-cb5f-4993-8555-ae64968fd714 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.793123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 794/1581] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.794064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47781-2fb5-48af-bfe5-13f93adfcb21 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.803897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47781-2fb5-48af-bfe5-13f93adfcb21 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.848573 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e388f3-cb5f-4993-8555-ae64968fd714 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.853564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986d6b-121c-435d-8a2f-74cd70f16d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.854794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986d6b-121c-435d-8a2f-74cd70f16d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.855077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986d6b-121c-435d-8a2f-74cd70f16d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.855361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986d6b-121c-435d-8a2f-74cd70f16d7a admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.856105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986d6b-121c-435d-8a2f-74cd70f16d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.857982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986d6b-121c-435d-8a2f-74cd70f16d7a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.860229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c0590-24d2-429c-9916-0d9a83a244d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.860889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0590-24d2-429c-9916-0d9a83a244d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.861193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0590-24d2-429c-9916-0d9a83a244d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.861465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0590-24d2-429c-9916-0d9a83a244d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.862170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c0590-24d2-429c-9916-0d9a83a244d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.864058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c0590-24d2-429c-9916-0d9a83a244d6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.878666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 788/1582] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.879849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986d6b-121c-435d-8a2f-74cd70f16d7a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.889872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 795/1583] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.889872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c0590-24d2-429c-9916-0d9a83a244d6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.890172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986d6b-121c-435d-8a2f-74cd70f16d7a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.894466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eaf33-41bd-49e8-9db8-349e5bf17cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.895117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eaf33-41bd-49e8-9db8-349e5bf17cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.895404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eaf33-41bd-49e8-9db8-349e5bf17cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.895678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eaf33-41bd-49e8-9db8-349e5bf17cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.896399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eaf33-41bd-49e8-9db8-349e5bf17cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.896994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c0590-24d2-429c-9916-0d9a83a244d6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.897982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eaf33-41bd-49e8-9db8-349e5bf17cb6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.902125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1392d9-a4ab-456d-8d63-a27c23121821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.902757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1392d9-a4ab-456d-8d63-a27c23121821 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.903039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1392d9-a4ab-456d-8d63-a27c23121821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.903314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1392d9-a4ab-456d-8d63-a27c23121821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.904020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1392d9-a4ab-456d-8d63-a27c23121821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.905590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1392d9-a4ab-456d-8d63-a27c23121821 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.911197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 789/1584] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:49.911197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eaf33-41bd-49e8-9db8-349e5bf17cb6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.915542 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 796/1585] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:49.917388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de5556-b9c0-4a5d-9573-03fac9ff99e7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.917673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de5556-b9c0-4a5d-9573-03fac9ff99e7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.917955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de5556-b9c0-4a5d-9573-03fac9ff99e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.919133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eaf33-41bd-49e8-9db8-349e5bf17cb6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.923718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b40887-2430-44c4-afaa-9d2c90a08577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.924356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b40887-2430-44c4-afaa-9d2c90a08577 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.924640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b40887-2430-44c4-afaa-9d2c90a08577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.924917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b40887-2430-44c4-afaa-9d2c90a08577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.925627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b40887-2430-44c4-afaa-9d2c90a08577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.927228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b40887-2430-44c4-afaa-9d2c90a08577 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.934699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c3de5556-b9c0-4a5d-9573-03fac9ff99e7 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:49.935905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c3de5556-b9c0-4a5d-9573-03fac9ff99e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:49.937299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 790/1586] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:49.938075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b40887-2430-44c4-afaa-9d2c90a08577 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.946909 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 797/1587] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:49.947099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b40887-2430-44c4-afaa-9d2c90a08577 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.948141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de5556-b9c0-4a5d-9573-03fac9ff99e7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.952160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db721b-97ca-4116-8178-98a7f3655ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.953009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db721b-97ca-4116-8178-98a7f3655ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.953210 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db721b-97ca-4116-8178-98a7f3655ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.953552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db721b-97ca-4116-8178-98a7f3655ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.954333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db721b-97ca-4116-8178-98a7f3655ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.956527 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db721b-97ca-4116-8178-98a7f3655ab9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.958443 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de5556-b9c0-4a5d-9573-03fac9ff99e7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.963090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace804c-1eee-409c-a6b5-df3ae39f58b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.964260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace804c-1eee-409c-a6b5-df3ae39f58b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.964546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace804c-1eee-409c-a6b5-df3ae39f58b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.964829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace804c-1eee-409c-a6b5-df3ae39f58b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.965546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace804c-1eee-409c-a6b5-df3ae39f58b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.967514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace804c-1eee-409c-a6b5-df3ae39f58b4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.977015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 791/1588] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:49 2022] POST /identity/v3/users => generated 291 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:49.977801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db721b-97ca-4116-8178-98a7f3655ab9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.982470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 798/1589] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:49.982470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace804c-1eee-409c-a6b5-df3ae39f58b4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:49.987758 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db721b-97ca-4116-8178-98a7f3655ab9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.990689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace804c-1eee-409c-a6b5-df3ae39f58b4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:49.992839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c76e7c-55a8-4160-a03f-7d7d4eb6df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.994200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c76e7c-55a8-4160-a03f-7d7d4eb6df9e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.994564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c76e7c-55a8-4160-a03f-7d7d4eb6df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.994936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c76e7c-55a8-4160-a03f-7d7d4eb6df9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.995345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b939d-6acb-4e73-bf18-dd1153f38027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:49.995934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c76e7c-55a8-4160-a03f-7d7d4eb6df9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.996040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b939d-6acb-4e73-bf18-dd1153f38027 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:49.996250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b939d-6acb-4e73-bf18-dd1153f38027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:49.996520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b939d-6acb-4e73-bf18-dd1153f38027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:49.997233 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b939d-6acb-4e73-bf18-dd1153f38027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:49.997865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c76e7c-55a8-4160-a03f-7d7d4eb6df9e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:49.998831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b939d-6acb-4e73-bf18-dd1153f38027 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.007811 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 792/1590] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:50.008583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c76e7c-55a8-4160-a03f-7d7d4eb6df9e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.010907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 799/1591] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:50.010907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b939d-6acb-4e73-bf18-dd1153f38027 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.018413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c76e7c-55a8-4160-a03f-7d7d4eb6df9e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.019773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b939d-6acb-4e73-bf18-dd1153f38027 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.023104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958da247-ab1a-4290-ba77-41a41c1ad370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.023724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da247-ab1a-4290-ba77-41a41c1ad370 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.024005 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da247-ab1a-4290-ba77-41a41c1ad370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.024276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da247-ab1a-4290-ba77-41a41c1ad370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.024658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5eb7b-0172-4ba8-b814-11679b36a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.024979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958da247-ab1a-4290-ba77-41a41c1ad370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.025582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5eb7b-0172-4ba8-b814-11679b36a255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.026414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5eb7b-0172-4ba8-b814-11679b36a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.026691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5eb7b-0172-4ba8-b814-11679b36a255 admin admin] PATH_INFO: `/v3/projects/1d9d2678724744c6850a20d91e9edfcb/users/5103784e6a764f78a97a7382730be895/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.027090 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958da247-ab1a-4290-ba77-41a41c1ad370 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.037004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 793/1592] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:50.037742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958da247-ab1a-4290-ba77-41a41c1ad370 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.044291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5eb7b-0172-4ba8-b814-11679b36a255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9d2678724744c6850a20d91e9edfcb, user_id=5103784e6a764f78a97a7382730be895, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.047055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5eb7b-0172-4ba8-b814-11679b36a255 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.048787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958da247-ab1a-4290-ba77-41a41c1ad370 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.054206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ffa80-8480-4b19-93ff-fb6e28611bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.055160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ffa80-8480-4b19-93ff-fb6e28611bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.055480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ffa80-8480-4b19-93ff-fb6e28611bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.055751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ffa80-8480-4b19-93ff-fb6e28611bd7 admin admin] PATH_INFO: `/v3/projects/bf36f753be81486182665056a949849c/users/2e4972b781b043f69740342fde4efa73/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.060715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 800/1593] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:50 2022] PUT /identity/v3/projects/1d9d2678724744c6850a20d91e9edfcb/users/5103784e6a764f78a97a7382730be895/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:50.061553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5eb7b-0172-4ba8-b814-11679b36a255 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.070051 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ffa80-8480-4b19-93ff-fb6e28611bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf36f753be81486182665056a949849c, user_id=2e4972b781b043f69740342fde4efa73, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.071080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-fa1ffa80-8480-4b19-93ff-fb6e28611bd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:41:50.071080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) May 17 15:41:50.071080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: May 17 15:41:50.073030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ffa80-8480-4b19-93ff-fb6e28611bd7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.085649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 794/1594] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:50 2022] PUT /identity/v3/projects/bf36f753be81486182665056a949849c/users/2e4972b781b043f69740342fde4efa73/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:50.090425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ffa80-8480-4b19-93ff-fb6e28611bd7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.116856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5eb7b-0172-4ba8-b814-11679b36a255 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.148899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ffa80-8480-4b19-93ff-fb6e28611bd7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.154036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb602c-761c-4ecb-9f34-b6c2f9d56f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.154699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb602c-761c-4ecb-9f34-b6c2f9d56f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.154981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb602c-761c-4ecb-9f34-b6c2f9d56f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.155257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb602c-761c-4ecb-9f34-b6c2f9d56f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.155983 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb602c-761c-4ecb-9f34-b6c2f9d56f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.157571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb602c-761c-4ecb-9f34-b6c2f9d56f35 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.162717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a69e4-7c78-4a43-aa31-fd9044b57f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.163353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a69e4-7c78-4a43-aa31-fd9044b57f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.163627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a69e4-7c78-4a43-aa31-fd9044b57f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.163898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a69e4-7c78-4a43-aa31-fd9044b57f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.167712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 795/1595] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:50.168496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb602c-761c-4ecb-9f34-b6c2f9d56f35 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.174193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a69e4-7c78-4a43-aa31-fd9044b57f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.175660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a69e4-7c78-4a43-aa31-fd9044b57f2d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.177478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb602c-761c-4ecb-9f34-b6c2f9d56f35 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.182468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d137a-8835-46bb-9566-cd9aa9ea6dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.183088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d137a-8835-46bb-9566-cd9aa9ea6dff admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.183373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d137a-8835-46bb-9566-cd9aa9ea6dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.183647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d137a-8835-46bb-9566-cd9aa9ea6dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.184348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d137a-8835-46bb-9566-cd9aa9ea6dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.185215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 801/1596] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:50.185901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d137a-8835-46bb-9566-cd9aa9ea6dff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.186135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a69e4-7c78-4a43-aa31-fd9044b57f2d service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.195278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a69e4-7c78-4a43-aa31-fd9044b57f2d service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.195750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 796/1597] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:50.196709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d137a-8835-46bb-9566-cd9aa9ea6dff admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.203874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8b235-18bc-4e12-88b2-85b1a3624576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.204774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8b235-18bc-4e12-88b2-85b1a3624576 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.205339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8b235-18bc-4e12-88b2-85b1a3624576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.205793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8b235-18bc-4e12-88b2-85b1a3624576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.206529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d137a-8835-46bb-9566-cd9aa9ea6dff admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.206658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8b235-18bc-4e12-88b2-85b1a3624576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.208437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8b235-18bc-4e12-88b2-85b1a3624576 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.211911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40c52e-a8c8-49ec-add3-24dc3f21db98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.212551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c52e-a8c8-49ec-add3-24dc3f21db98 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.212802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c52e-a8c8-49ec-add3-24dc3f21db98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.213072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c52e-a8c8-49ec-add3-24dc3f21db98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.214360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40c52e-a8c8-49ec-add3-24dc3f21db98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.215959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40c52e-a8c8-49ec-add3-24dc3f21db98 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.219934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 802/1598] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:50.220724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8b235-18bc-4e12-88b2-85b1a3624576 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.230923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 797/1599] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:50.230923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04d51d-049d-4994-bfd2-38fc64c8eeab None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.230923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04d51d-049d-4994-bfd2-38fc64c8eeab None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.230923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04d51d-049d-4994-bfd2-38fc64c8eeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.231594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8b235-18bc-4e12-88b2-85b1a3624576 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.238565 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5b5f3-d1ba-465c-b63a-7fce873ab8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.239750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5b5f3-d1ba-465c-b63a-7fce873ab8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.240382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5b5f3-d1ba-465c-b63a-7fce873ab8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.240878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5b5f3-d1ba-465c-b63a-7fce873ab8f1 admin admin] PATH_INFO: `/v3/projects/b23dc4cf2a954ab8a64c81eac9080a70/users/d099a8ecc77b4259aa30f227ae8f28ad/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.257529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8f04d51d-049d-4994-bfd2-38fc64c8eeab None None] MFA Rules not processed for user `5103784e6a764f78a97a7382730be895`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:50.257764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5b5f3-d1ba-465c-b63a-7fce873ab8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23dc4cf2a954ab8a64c81eac9080a70, user_id=d099a8ecc77b4259aa30f227ae8f28ad, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.258782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8f04d51d-049d-4994-bfd2-38fc64c8eeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:50.262628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5b5f3-d1ba-465c-b63a-7fce873ab8f1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.278395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 803/1600] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:50 2022] PUT /identity/v3/projects/b23dc4cf2a954ab8a64c81eac9080a70/users/d099a8ecc77b4259aa30f227ae8f28ad/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:50.280125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67651b11-a252-4db1-bb76-603f9a06728c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.280571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67651b11-a252-4db1-bb76-603f9a06728c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.281004 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67651b11-a252-4db1-bb76-603f9a06728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.301951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-67651b11-a252-4db1-bb76-603f9a06728c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:50.303191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-67651b11-a252-4db1-bb76-603f9a06728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:50.328477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 798/1601] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:50.329350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04d51d-049d-4994-bfd2-38fc64c8eeab None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.343642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04d51d-049d-4994-bfd2-38fc64c8eeab None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.377865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 804/1602] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:50.378773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67651b11-a252-4db1-bb76-603f9a06728c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.400492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67651b11-a252-4db1-bb76-603f9a06728c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.405964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a716bc2-03ce-4c64-b7fc-3ea6757f65b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.406961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a716bc2-03ce-4c64-b7fc-3ea6757f65b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.407330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a716bc2-03ce-4c64-b7fc-3ea6757f65b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.407674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a716bc2-03ce-4c64-b7fc-3ea6757f65b6 admin admin] PATH_INFO: `/v3/projects/6921a8fdfe4d4c06b69a31392ae2dcbf/users/f765820a65e34d0b9d19a602f022b278/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.418482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057972e-5c69-4810-8c52-29ad9a1b7271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.419228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057972e-5c69-4810-8c52-29ad9a1b7271 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.419612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057972e-5c69-4810-8c52-29ad9a1b7271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.419954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057972e-5c69-4810-8c52-29ad9a1b7271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.420810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057972e-5c69-4810-8c52-29ad9a1b7271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.422597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057972e-5c69-4810-8c52-29ad9a1b7271 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.423922 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a716bc2-03ce-4c64-b7fc-3ea6757f65b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6921a8fdfe4d4c06b69a31392ae2dcbf, user_id=f765820a65e34d0b9d19a602f022b278, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.427001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a716bc2-03ce-4c64-b7fc-3ea6757f65b6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.434035 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 799/1603] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:50.434908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057972e-5c69-4810-8c52-29ad9a1b7271 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.444167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 805/1604] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:50 2022] PUT /identity/v3/projects/6921a8fdfe4d4c06b69a31392ae2dcbf/users/f765820a65e34d0b9d19a602f022b278/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:50.444828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057972e-5c69-4810-8c52-29ad9a1b7271 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.455794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a716bc2-03ce-4c64-b7fc-3ea6757f65b6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.518130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d9da3-0fe4-4568-9f8d-afb8de76016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.519360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d9da3-0fe4-4568-9f8d-afb8de76016e admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.519913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d9da3-0fe4-4568-9f8d-afb8de76016e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.520173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d9da3-0fe4-4568-9f8d-afb8de76016e admin admin] PATH_INFO: `/v3/projects/fff0cdf39b5643d1bc546c163773df6e/users/526ae619a6ca4c38ba1ecbe9b284151a/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.522702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a716bc2-03ce-4c64-b7fc-3ea6757f65b6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.529734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd2944-5c3f-47e5-b47c-7fc0bcde07e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.530991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2944-5c3f-47e5-b47c-7fc0bcde07e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.531280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2944-5c3f-47e5-b47c-7fc0bcde07e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.531556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2944-5c3f-47e5-b47c-7fc0bcde07e0 admin admin] PATH_INFO: `/v3/projects/5e120255943e4fecadc7d4a2a9188f9d/users/df32bb55daa64c5396bd96a86f19b5d8/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.548373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd2944-5c3f-47e5-b47c-7fc0bcde07e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e120255943e4fecadc7d4a2a9188f9d, user_id=df32bb55daa64c5396bd96a86f19b5d8, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.549032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d9da3-0fe4-4568-9f8d-afb8de76016e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff0cdf39b5643d1bc546c163773df6e, user_id=526ae619a6ca4c38ba1ecbe9b284151a, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.551407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd2944-5c3f-47e5-b47c-7fc0bcde07e0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.552241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d9da3-0fe4-4568-9f8d-afb8de76016e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.566839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 806/1606] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:50 2022] PUT /identity/v3/projects/5e120255943e4fecadc7d4a2a9188f9d/users/df32bb55daa64c5396bd96a86f19b5d8/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:50.567057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 800/1606] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:50 2022] PUT /identity/v3/projects/fff0cdf39b5643d1bc546c163773df6e/users/526ae619a6ca4c38ba1ecbe9b284151a/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:50.567880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d9da3-0fe4-4568-9f8d-afb8de76016e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.581095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b891df1-e43a-46a4-a3ab-d499b74f503d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.581095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b891df1-e43a-46a4-a3ab-d499b74f503d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.581095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b891df1-e43a-46a4-a3ab-d499b74f503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.597102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4b891df1-e43a-46a4-a3ab-d499b74f503d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:50.598667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4b891df1-e43a-46a4-a3ab-d499b74f503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:50.644680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d9da3-0fe4-4568-9f8d-afb8de76016e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.648890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aaf53-a76d-4005-9aa7-9e00247a00a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.649725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aaf53-a76d-4005-9aa7-9e00247a00a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.649852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aaf53-a76d-4005-9aa7-9e00247a00a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.650116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aaf53-a76d-4005-9aa7-9e00247a00a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.650839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aaf53-a76d-4005-9aa7-9e00247a00a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.652731 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aaf53-a76d-4005-9aa7-9e00247a00a5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.674749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 807/1607] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:50.675656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b891df1-e43a-46a4-a3ab-d499b74f503d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.686054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 801/1608] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:50 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:50.686849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aaf53-a76d-4005-9aa7-9e00247a00a5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.738455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b891df1-e43a-46a4-a3ab-d499b74f503d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.757236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aaf53-a76d-4005-9aa7-9e00247a00a5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:50.763212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e4be9-b7dc-4fc2-8590-9a86e8d9c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.763940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4be9-b7dc-4fc2-8590-9a86e8d9c086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.764321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4be9-b7dc-4fc2-8590-9a86e8d9c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.764660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4be9-b7dc-4fc2-8590-9a86e8d9c086 admin admin] PATH_INFO: `/v3/projects/968ff1a7ccb34504a91156845726c416/users/855af005a03a456baaac4c79f2906318/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.780262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e4be9-b7dc-4fc2-8590-9a86e8d9c086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968ff1a7ccb34504a91156845726c416, user_id=855af005a03a456baaac4c79f2906318, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.783375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e4be9-b7dc-4fc2-8590-9a86e8d9c086 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.794196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ee3c5-e156-44f0-b527-2275b8ed9a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:50.795680 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ee3c5-e156-44f0-b527-2275b8ed9a02 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.796438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ee3c5-e156-44f0-b527-2275b8ed9a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.796843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ee3c5-e156-44f0-b527-2275b8ed9a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.800847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 802/1609] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:50 2022] PUT /identity/v3/projects/968ff1a7ccb34504a91156845726c416/users/855af005a03a456baaac4c79f2906318/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:50.802439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbebb1-ea4b-499c-b5d1-872c034b902b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.802734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbebb1-ea4b-499c-b5d1-872c034b902b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.803011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbebb1-ea4b-499c-b5d1-872c034b902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.809202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ee3c5-e156-44f0-b527-2275b8ed9a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:50.810966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ee3c5-e156-44f0-b527-2275b8ed9a02 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:50.822474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 808/1610] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:50.824605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136bd84-54e3-4bb5-84cd-944acc663fe0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.825012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136bd84-54e3-4bb5-84cd-944acc663fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.825336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136bd84-54e3-4bb5-84cd-944acc663fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.835020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-09bbebb1-ea4b-499c-b5d1-872c034b902b None None] MFA Rules not processed for user `f765820a65e34d0b9d19a602f022b278`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:50.836336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-09bbebb1-ea4b-499c-b5d1-872c034b902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:50.843502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9136bd84-54e3-4bb5-84cd-944acc663fe0 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:50.845047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9136bd84-54e3-4bb5-84cd-944acc663fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:50.917940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 809/1611] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:50.917940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf007c-b0f1-429e-83cb-c3293cadc27c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:50.917940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf007c-b0f1-429e-83cb-c3293cadc27c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:50.917940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf007c-b0f1-429e-83cb-c3293cadc27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:50.933354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 803/1612] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:50.933354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbebb1-ea4b-499c-b5d1-872c034b902b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:50.953329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-abaf007c-b0f1-429e-83cb-c3293cadc27c None None] MFA Rules not processed for user `526ae619a6ca4c38ba1ecbe9b284151a`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:50.954764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-abaf007c-b0f1-429e-83cb-c3293cadc27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:51.034147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 810/1613] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:51.034147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf007c-b0f1-429e-83cb-c3293cadc27c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.050369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf007c-b0f1-429e-83cb-c3293cadc27c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.052411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbebb1-ea4b-499c-b5d1-872c034b902b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.058481 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120a60-dc88-4356-8f3e-79e96b055623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.059287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120a60-dc88-4356-8f3e-79e96b055623 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.059605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120a60-dc88-4356-8f3e-79e96b055623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.059994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120a60-dc88-4356-8f3e-79e96b055623 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.060754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120a60-dc88-4356-8f3e-79e96b055623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.064285 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120a60-dc88-4356-8f3e-79e96b055623 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.074117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf89a-9eb7-4cf8-a382-4a8709f45b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.077663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf89a-9eb7-4cf8-a382-4a8709f45b54 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.079800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf89a-9eb7-4cf8-a382-4a8709f45b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.080097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf89a-9eb7-4cf8-a382-4a8709f45b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.098523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 811/1614] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:51 2022] POST /identity/v3/users => generated 309 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:51.101715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e13d5-e5d5-41d5-8082-f14461028886 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.102297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e13d5-e5d5-41d5-8082-f14461028886 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.103441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cf89a-9eb7-4cf8-a382-4a8709f45b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.104693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e13d5-e5d5-41d5-8082-f14461028886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.108350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cf89a-9eb7-4cf8-a382-4a8709f45b54 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.136093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 804/1615] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:51.137104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf89a-9eb7-4cf8-a382-4a8709f45b54 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.149837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c32e13d5-e5d5-41d5-8082-f14461028886 None None] MFA Rules not processed for user `855af005a03a456baaac4c79f2906318`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:51.152650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c32e13d5-e5d5-41d5-8082-f14461028886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:51.162134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf89a-9eb7-4cf8-a382-4a8709f45b54 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.172681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9804f-c897-421e-927b-5853bc93ac59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.173597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9804f-c897-421e-927b-5853bc93ac59 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.173886 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9804f-c897-421e-927b-5853bc93ac59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.174201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9804f-c897-421e-927b-5853bc93ac59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.196684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9804f-c897-421e-927b-5853bc93ac59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.198533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9804f-c897-421e-927b-5853bc93ac59 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.211179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 805/1616] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:51.212583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34783978-7e88-4f27-97b8-268fe7d6ff1c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.212881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34783978-7e88-4f27-97b8-268fe7d6ff1c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.213444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34783978-7e88-4f27-97b8-268fe7d6ff1c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.215222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 806/1617] 10.222.0.75 () {54 vars in 961 bytes} [Tue May 17 15:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:41:51.222634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34783978-7e88-4f27-97b8-268fe7d6ff1c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.246960 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34783978-7e88-4f27-97b8-268fe7d6ff1c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.249428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 812/1618] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:51.250627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e13d5-e5d5-41d5-8082-f14461028886 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.257773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10475-4444-48f7-935b-c93dfbd0494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.258913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10475-4444-48f7-935b-c93dfbd0494d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.259330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10475-4444-48f7-935b-c93dfbd0494d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.259629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10475-4444-48f7-935b-c93dfbd0494d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.260759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c10475-4444-48f7-935b-c93dfbd0494d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.262781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c10475-4444-48f7-935b-c93dfbd0494d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.266186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e13d5-e5d5-41d5-8082-f14461028886 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.272678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91be805-358e-414c-8275-3c42f187ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.273624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91be805-358e-414c-8275-3c42f187ce45 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.274302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91be805-358e-414c-8275-3c42f187ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.274652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91be805-358e-414c-8275-3c42f187ce45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.275545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91be805-358e-414c-8275-3c42f187ce45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.278366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91be805-358e-414c-8275-3c42f187ce45 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.295776 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 813/1619] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:51.297233 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858b0df-28b9-46d1-8a76-c3746091b5a0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.297623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858b0df-28b9-46d1-8a76-c3746091b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.298154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858b0df-28b9-46d1-8a76-c3746091b5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.304289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 807/1620] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:51 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:51.305374 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10475-4444-48f7-935b-c93dfbd0494d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.323953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5858b0df-28b9-46d1-8a76-c3746091b5a0 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:51.325757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5858b0df-28b9-46d1-8a76-c3746091b5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:51.397240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10475-4444-48f7-935b-c93dfbd0494d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.403088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e25f46-d2a2-4ee1-9c82-b64969bcdbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.404120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e25f46-d2a2-4ee1-9c82-b64969bcdbcb admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.404656 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e25f46-d2a2-4ee1-9c82-b64969bcdbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.405204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e25f46-d2a2-4ee1-9c82-b64969bcdbcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.406190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e25f46-d2a2-4ee1-9c82-b64969bcdbcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.408427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e25f46-d2a2-4ee1-9c82-b64969bcdbcb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.424777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 814/1621] 10.222.0.75 () {58 vars in 1058 bytes} [Tue May 17 15:41:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:51.425922 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858b0df-28b9-46d1-8a76-c3746091b5a0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.440465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858b0df-28b9-46d1-8a76-c3746091b5a0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.443307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 808/1622] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:51 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:51.445069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e25f46-d2a2-4ee1-9c82-b64969bcdbcb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.543539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e25f46-d2a2-4ee1-9c82-b64969bcdbcb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.550432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e6c9-80b9-4a30-b4ce-3c292aa7be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.551321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e6c9-80b9-4a30-b4ce-3c292aa7be93 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.551700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e6c9-80b9-4a30-b4ce-3c292aa7be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.551982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e6c9-80b9-4a30-b4ce-3c292aa7be93 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.552821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653e6c9-80b9-4a30-b4ce-3c292aa7be93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.556203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653e6c9-80b9-4a30-b4ce-3c292aa7be93 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.556400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb4f6f-79bb-43c9-bb5f-36bbdf3def35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.557839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb4f6f-79bb-43c9-bb5f-36bbdf3def35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.559270 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb4f6f-79bb-43c9-bb5f-36bbdf3def35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.559761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb4f6f-79bb-43c9-bb5f-36bbdf3def35 admin admin] PATH_INFO: `/v3/projects/03e2126ec37242119dfbe2032df1dfd0/users/503424287a084e5891cb490238166e28/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.590468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 809/1623] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:51 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:51.591826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e6c9-80b9-4a30-b4ce-3c292aa7be93 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.600094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb4f6f-79bb-43c9-bb5f-36bbdf3def35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e2126ec37242119dfbe2032df1dfd0, user_id=503424287a084e5891cb490238166e28, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.606609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb4f6f-79bb-43c9-bb5f-36bbdf3def35 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.631768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 815/1624] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:51 2022] PUT /identity/v3/projects/03e2126ec37242119dfbe2032df1dfd0/users/503424287a084e5891cb490238166e28/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:51.632868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb4f6f-79bb-43c9-bb5f-36bbdf3def35 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.727347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e6c9-80b9-4a30-b4ce-3c292aa7be93 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.772695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb4f6f-79bb-43c9-bb5f-36bbdf3def35 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.787416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e1534-9fdf-477c-8b3b-4c8de84fc396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.788208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e1534-9fdf-477c-8b3b-4c8de84fc396 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.788808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e1534-9fdf-477c-8b3b-4c8de84fc396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.789576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e1534-9fdf-477c-8b3b-4c8de84fc396 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.789772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e1534-9fdf-477c-8b3b-4c8de84fc396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.793416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e1534-9fdf-477c-8b3b-4c8de84fc396 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.832638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17212e-2aba-4db1-8431-01e36107bf49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.834624 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17212e-2aba-4db1-8431-01e36107bf49 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.835652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17212e-2aba-4db1-8431-01e36107bf49 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.835884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17212e-2aba-4db1-8431-01e36107bf49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.842957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 816/1625] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:41:51 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:51.844253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e1534-9fdf-477c-8b3b-4c8de84fc396 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.865630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e1534-9fdf-477c-8b3b-4c8de84fc396 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.882297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc08434-8584-4ef4-824b-5bf5fa59ad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.883178 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc08434-8584-4ef4-824b-5bf5fa59ad43 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.883464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc08434-8584-4ef4-824b-5bf5fa59ad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.883731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc08434-8584-4ef4-824b-5bf5fa59ad43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.884599 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc08434-8584-4ef4-824b-5bf5fa59ad43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.889063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc08434-8584-4ef4-824b-5bf5fa59ad43 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.911699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 817/1626] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:51.917535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc08434-8584-4ef4-824b-5bf5fa59ad43 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.939713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc08434-8584-4ef4-824b-5bf5fa59ad43 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.951103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17212e-2aba-4db1-8431-01e36107bf49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.954621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17212e-2aba-4db1-8431-01e36107bf49 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.957031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122af3d-1b29-434e-85f9-87178259e6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.957721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122af3d-1b29-434e-85f9-87178259e6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.958029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122af3d-1b29-434e-85f9-87178259e6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.958295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122af3d-1b29-434e-85f9-87178259e6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:51.959027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122af3d-1b29-434e-85f9-87178259e6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:51.960647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122af3d-1b29-434e-85f9-87178259e6eb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:51.969629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 810/1627] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:51.970542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17212e-2aba-4db1-8431-01e36107bf49 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.982686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 818/1628] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:51.985400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122af3d-1b29-434e-85f9-87178259e6eb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:51.990802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17212e-2aba-4db1-8431-01e36107bf49 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:51.997535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78a47-57b3-4f8b-b7c3-41f046a024e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:51.998835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78a47-57b3-4f8b-b7c3-41f046a024e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:51.998982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78a47-57b3-4f8b-b7c3-41f046a024e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:51.999731 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78a47-57b3-4f8b-b7c3-41f046a024e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.001415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78a47-57b3-4f8b-b7c3-41f046a024e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:52.005156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78a47-57b3-4f8b-b7c3-41f046a024e2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:52.018253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122af3d-1b29-434e-85f9-87178259e6eb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:52.033485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5665c-ad92-419f-84bc-c71d999e8ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:52.034421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5665c-ad92-419f-84bc-c71d999e8ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.034699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5665c-ad92-419f-84bc-c71d999e8ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.035154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 811/1629] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:52.036470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78a47-57b3-4f8b-b7c3-41f046a024e2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:52.044295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5665c-ad92-419f-84bc-c71d999e8ea7 admin admin] PATH_INFO: `/v3/projects/7447666cb0294be18bf08101bdef9168/users/899c3defe43c40f7a0310f541eb08ae7/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.048949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78a47-57b3-4f8b-b7c3-41f046a024e2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:52.055360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1bce3-ba2c-46b3-aead-b92613dd37f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:52.056547 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1bce3-ba2c-46b3-aead-b92613dd37f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.056832 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1bce3-ba2c-46b3-aead-b92613dd37f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.057189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1bce3-ba2c-46b3-aead-b92613dd37f2 admin admin] PATH_INFO: `/v3/projects/03e2126ec37242119dfbe2032df1dfd0/users/503424287a084e5891cb490238166e28/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.059361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1bce3-ba2c-46b3-aead-b92613dd37f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e2126ec37242119dfbe2032df1dfd0, user_id=503424287a084e5891cb490238166e28, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:52.062777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1bce3-ba2c-46b3-aead-b92613dd37f2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:52.091085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5665c-ad92-419f-84bc-c71d999e8ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7447666cb0294be18bf08101bdef9168, user_id=899c3defe43c40f7a0310f541eb08ae7, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:52.093875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5665c-ad92-419f-84bc-c71d999e8ea7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:52.115108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 812/1630] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:52 2022] PUT /identity/v3/projects/03e2126ec37242119dfbe2032df1dfd0/users/503424287a084e5891cb490238166e28/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:52.120782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 819/1631] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:51 2022] PUT /identity/v3/projects/7447666cb0294be18bf08101bdef9168/users/899c3defe43c40f7a0310f541eb08ae7/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:52.120959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1bce3-ba2c-46b3-aead-b92613dd37f2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:52.122086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5665c-ad92-419f-84bc-c71d999e8ea7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:52.279721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5665c-ad92-419f-84bc-c71d999e8ea7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:52.296503 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a25b9-620e-4536-8b28-b9e236cffa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:52.297118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a25b9-620e-4536-8b28-b9e236cffa92 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.297705 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a25b9-620e-4536-8b28-b9e236cffa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.298109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a25b9-620e-4536-8b28-b9e236cffa92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.298858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a25b9-620e-4536-8b28-b9e236cffa92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:52.301073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a25b9-620e-4536-8b28-b9e236cffa92 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:52.310331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1bce3-ba2c-46b3-aead-b92613dd37f2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:52.328171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 820/1632] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:52.331384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a037-3e54-442a-904d-11c58edc6e4e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.331693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a037-3e54-442a-904d-11c58edc6e4e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.332944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a037-3e54-442a-904d-11c58edc6e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.336980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952cfa9-5c3b-470d-85a0-36f7587703c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:52.338521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952cfa9-5c3b-470d-85a0-36f7587703c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.339401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952cfa9-5c3b-470d-85a0-36f7587703c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.340237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952cfa9-5c3b-470d-85a0-36f7587703c0 admin admin] PATH_INFO: `/v3/projects/8079cea5dbf14e789cf2dfd6d9529beb/users/0fd45c6799124027994ef3c8939410c5/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.387615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952cfa9-5c3b-470d-85a0-36f7587703c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8079cea5dbf14e789cf2dfd6d9529beb, user_id=0fd45c6799124027994ef3c8939410c5, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:52.392570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8d19a037-3e54-442a-904d-11c58edc6e4e None None] MFA Rules not processed for user `503424287a084e5891cb490238166e28`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:52.394027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8d19a037-3e54-442a-904d-11c58edc6e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:52.400528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952cfa9-5c3b-470d-85a0-36f7587703c0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:52.424249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 813/1633] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:52 2022] PUT /identity/v3/projects/8079cea5dbf14e789cf2dfd6d9529beb/users/0fd45c6799124027994ef3c8939410c5/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:52.427788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952cfa9-5c3b-470d-85a0-36f7587703c0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:52.710086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 821/1634] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:52.710086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a037-3e54-442a-904d-11c58edc6e4e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:52.737489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952cfa9-5c3b-470d-85a0-36f7587703c0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:52.752160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a037-3e54-442a-904d-11c58edc6e4e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:52.755399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb6549-679a-4fe7-ae00-4eb2f93db7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:52.757155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb6549-679a-4fe7-ae00-4eb2f93db7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.758390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb6549-679a-4fe7-ae00-4eb2f93db7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.759725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb6549-679a-4fe7-ae00-4eb2f93db7f0 admin admin] PATH_INFO: `/v3/projects/7447666cb0294be18bf08101bdef9168/users/899c3defe43c40f7a0310f541eb08ae7/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.763517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb6549-679a-4fe7-ae00-4eb2f93db7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7447666cb0294be18bf08101bdef9168, user_id=899c3defe43c40f7a0310f541eb08ae7, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:52.765018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fd6ff-7d37-4590-835f-63dccf34b3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:52.766947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd6ff-7d37-4590-835f-63dccf34b3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.768102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd6ff-7d37-4590-835f-63dccf34b3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.769941 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb6549-679a-4fe7-ae00-4eb2f93db7f0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:52.770524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd6ff-7d37-4590-835f-63dccf34b3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.771693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fd6ff-7d37-4590-835f-63dccf34b3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:52.773348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fd6ff-7d37-4590-835f-63dccf34b3ad admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:52.808252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 822/1635] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:41:52.808434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 814/1636] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:52 2022] PUT /identity/v3/projects/7447666cb0294be18bf08101bdef9168/users/899c3defe43c40f7a0310f541eb08ae7/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:52.809179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb6549-679a-4fe7-ae00-4eb2f93db7f0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:52.809877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be190f8-32e6-4e62-9517-dc2d9ca7915a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.811112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be190f8-32e6-4e62-9517-dc2d9ca7915a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.812609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be190f8-32e6-4e62-9517-dc2d9ca7915a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.816910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 823/1637] 10.222.0.75 () {54 vars in 912 bytes} [Tue May 17 15:41:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:41:52.822996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be190f8-32e6-4e62-9517-dc2d9ca7915a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:52.904909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb6549-679a-4fe7-ae00-4eb2f93db7f0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:52.919784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0f27-8a26-406a-b52c-e9682190c7a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:52.921133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0f27-8a26-406a-b52c-e9682190c7a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.921509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0f27-8a26-406a-b52c-e9682190c7a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.921965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0f27-8a26-406a-b52c-e9682190c7a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.960100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be190f8-32e6-4e62-9517-dc2d9ca7915a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:52.969272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5d95-cc91-4234-9938-390578d25b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:52.970615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5d95-cc91-4234-9938-390578d25b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:52.971656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5d95-cc91-4234-9938-390578d25b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:52.973009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5d95-cc91-4234-9938-390578d25b89 admin admin] PATH_INFO: `/v3/projects/8079cea5dbf14e789cf2dfd6d9529beb/users/0fd45c6799124027994ef3c8939410c5/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:52.980266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a5d95-cc91-4234-9938-390578d25b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8079cea5dbf14e789cf2dfd6d9529beb, user_id=0fd45c6799124027994ef3c8939410c5, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:52.986225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a5d95-cc91-4234-9938-390578d25b89 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:53.007492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 824/1638] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:41:52 2022] PUT /identity/v3/projects/8079cea5dbf14e789cf2dfd6d9529beb/users/0fd45c6799124027994ef3c8939410c5/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:53.026910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016a0a-df60-4ea8-ae37-11175a813be7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:53.027339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016a0a-df60-4ea8-ae37-11175a813be7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:53.027625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016a0a-df60-4ea8-ae37-11175a813be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:53.066331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0f27-8a26-406a-b52c-e9682190c7a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:53.069892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0f27-8a26-406a-b52c-e9682190c7a6 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:53.089910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e5016a0a-df60-4ea8-ae37-11175a813be7 None None] MFA Rules not processed for user `899c3defe43c40f7a0310f541eb08ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:53.091191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e5016a0a-df60-4ea8-ae37-11175a813be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:53.094706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 815/1639] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:53.112119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e175-ce47-4c93-b5a8-ab2393b11cc2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:53.112435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e175-ce47-4c93-b5a8-ab2393b11cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:53.113077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e175-ce47-4c93-b5a8-ab2393b11cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:53.165060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7020e175-ce47-4c93-b5a8-ab2393b11cc2 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:53.166423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7020e175-ce47-4c93-b5a8-ab2393b11cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:53.397682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 825/1640] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:53.397682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb0e90-5f66-4ff6-b3e5-843074359724 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:53.397682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb0e90-5f66-4ff6-b3e5-843074359724 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:53.397682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb0e90-5f66-4ff6-b3e5-843074359724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:53.413558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 816/1641] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:53.424500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020e175-ce47-4c93-b5a8-ab2393b11cc2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:53.479740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-48cb0e90-5f66-4ff6-b3e5-843074359724 None None] MFA Rules not processed for user `0fd45c6799124027994ef3c8939410c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:53.486170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-48cb0e90-5f66-4ff6-b3e5-843074359724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:53.583818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020e175-ce47-4c93-b5a8-ab2393b11cc2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:53.593088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec31a5-2f02-46a9-8c15-6586b8e348cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:53.594298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec31a5-2f02-46a9-8c15-6586b8e348cd service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:53.594298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec31a5-2f02-46a9-8c15-6586b8e348cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:53.594298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec31a5-2f02-46a9-8c15-6586b8e348cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:53.614511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec31a5-2f02-46a9-8c15-6586b8e348cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:53.617756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec31a5-2f02-46a9-8c15-6586b8e348cd service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:53.630226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 826/1642] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:53.631718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb0e90-5f66-4ff6-b3e5-843074359724 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:53.643642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 817/1643] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:53.645233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec31a5-2f02-46a9-8c15-6586b8e348cd service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:53.671361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec31a5-2f02-46a9-8c15-6586b8e348cd service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:53.684257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a26e1-1434-4906-9acf-a04f4f6c827b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:53.685062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a26e1-1434-4906-9acf-a04f4f6c827b service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:53.685347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a26e1-1434-4906-9acf-a04f4f6c827b service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:53.685616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a26e1-1434-4906-9acf-a04f4f6c827b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:53.709410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a26e1-1434-4906-9acf-a04f4f6c827b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:53.712928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a26e1-1434-4906-9acf-a04f4f6c827b service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:53.737912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb0e90-5f66-4ff6-b3e5-843074359724 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:53.748452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:53.749671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:53.751380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:53.752040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] PATH_INFO: `/v3/users/5103784e6a764f78a97a7382730be895` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:53.752863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 818/1644] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:53.754629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5103784e6a764f78a97a7382730be895)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:53.756290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18597cd-3f20-4d7f-a26e-459131fdea1c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:53.756586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18597cd-3f20-4d7f-a26e-459131fdea1c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:53.756862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:53.756980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18597cd-3f20-4d7f-a26e-459131fdea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:53.826458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a18597cd-3f20-4d7f-a26e-459131fdea1c None None] MFA Rules not processed for user `df32bb55daa64c5396bd96a86f19b5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:53.830115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a18597cd-3f20-4d7f-a26e-459131fdea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:53.848466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5103784e6a764f78a97a7382730be895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:53.885775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5103784e6a764f78a97a7382730be895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:53.887601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5103784e6a764f78a97a7382730be895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:53.888395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5103784e6a764f78a97a7382730be895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:53.906523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5103784e6a764f78a97a7382730be895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:53.944477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 827/1645] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:41:53 2022] DELETE /identity/v3/users/5103784e6a764f78a97a7382730be895 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:53.959463 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:53.965313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:53.988769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 819/1646] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:53.992703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9861f-f600-4920-8b9e-8cbdeaeb20d4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:53.993125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9861f-f600-4920-8b9e-8cbdeaeb20d4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:53.993564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9861f-f600-4920-8b9e-8cbdeaeb20d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:54.029009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-80c9861f-f600-4920-8b9e-8cbdeaeb20d4 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:54.032248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-80c9861f-f600-4920-8b9e-8cbdeaeb20d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:54.108283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fd0db-45b2-4de5-a525-054b1f77929d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:54.123468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:54.124164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:54.124455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:54.124740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:54.130701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:54.195474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 820/1647] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:54.196741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cba876-d2ac-40f7-b287-1e07ce78d0c2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:54.198416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cba876-d2ac-40f7-b287-1e07ce78d0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:54.198862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cba876-d2ac-40f7-b287-1e07ce78d0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:54.235209 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-86cba876-d2ac-40f7-b287-1e07ce78d0c2 None None] MFA Rules not processed for user `df32bb55daa64c5396bd96a86f19b5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:54.236601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-86cba876-d2ac-40f7-b287-1e07ce78d0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:54.324300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:54.326141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:54.351071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 828/1648] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:54.368432 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:54.378959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:54.418817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 821/1649] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:54.427762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ac853-a67a-434b-b168-e4035f8bd47f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:54.428516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ac853-a67a-434b-b168-e4035f8bd47f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:54.429000 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ac853-a67a-434b-b168-e4035f8bd47f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:54.431161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 822/1650] 10.222.0.75 () {54 vars in 961 bytes} [Tue May 17 15:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:41:54.454665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f7989-4694-4a3e-930c-2a921f73db6b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:54.454665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f7989-4694-4a3e-930c-2a921f73db6b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:54.454939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f7989-4694-4a3e-930c-2a921f73db6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:54.489775 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cc7f7989-4694-4a3e-930c-2a921f73db6b None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:54.493945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cc7f7989-4694-4a3e-930c-2a921f73db6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:54.584836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7360f25-6b4e-4164-98b7-aecbd8ab001b service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:54.591877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee563-263a-4941-8dce-832f6cbf6215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:54.592613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee563-263a-4941-8dce-832f6cbf6215 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:54.592806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee563-263a-4941-8dce-832f6cbf6215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:54.593091 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee563-263a-4941-8dce-832f6cbf6215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:54.611913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee563-263a-4941-8dce-832f6cbf6215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:54.616573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee563-263a-4941-8dce-832f6cbf6215 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:54.637856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 829/1651] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:54.731398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 823/1652] 10.222.0.75 () {58 vars in 1058 bytes} [Tue May 17 15:41:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:41:54.740820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee563-263a-4941-8dce-832f6cbf6215 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:54.762831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee563-263a-4941-8dce-832f6cbf6215 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:54.782893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24775281-db95-4f6b-9872-c7a78f003ed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:54.786651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24775281-db95-4f6b-9872-c7a78f003ed8 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:54.787119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24775281-db95-4f6b-9872-c7a78f003ed8 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:54.787658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24775281-db95-4f6b-9872-c7a78f003ed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:54.815283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24775281-db95-4f6b-9872-c7a78f003ed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:54.820544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24775281-db95-4f6b-9872-c7a78f003ed8 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:54.875638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 830/1653] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:55.599369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f7989-4694-4a3e-930c-2a921f73db6b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:55.621124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f7989-4694-4a3e-930c-2a921f73db6b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:55.646032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04733488-e3e2-4b87-9344-1032b7cfa5c7 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd45c6799124027994ef3c8939410c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8079cea5dbf14e789cf2dfd6d9529beb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:55.646819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04733488-e3e2-4b87-9344-1032b7cfa5c7 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:55.647112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04733488-e3e2-4b87-9344-1032b7cfa5c7 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:55.647395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04733488-e3e2-4b87-9344-1032b7cfa5c7 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:55.648144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04733488-e3e2-4b87-9344-1032b7cfa5c7 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:55.648455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04733488-e3e2-4b87-9344-1032b7cfa5c7 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:55.651983 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04733488-e3e2-4b87-9344-1032b7cfa5c7 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:55.720696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 824/1654] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:55.722542 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24775281-db95-4f6b-9872-c7a78f003ed8 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:55.766082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24775281-db95-4f6b-9872-c7a78f003ed8 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:55.781374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005645e9-ff5b-494d-bc93-f9048a9e5c7d tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd45c6799124027994ef3c8939410c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8079cea5dbf14e789cf2dfd6d9529beb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:55.782789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005645e9-ff5b-494d-bc93-f9048a9e5c7d tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:55.783083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005645e9-ff5b-494d-bc93-f9048a9e5c7d tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:55.783367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005645e9-ff5b-494d-bc93-f9048a9e5c7d tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:55.784274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005645e9-ff5b-494d-bc93-f9048a9e5c7d tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:55.786801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005645e9-ff5b-494d-bc93-f9048a9e5c7d tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:55.855703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 831/1655] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:41:55 2022] POST /identity/v3/projects => generated 353 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:41:55.856596 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc869b-9ddc-4c11-aa09-3d07004853b6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:55.857080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc869b-9ddc-4c11-aa09-3d07004853b6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:55.857275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc869b-9ddc-4c11-aa09-3d07004853b6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:55.858140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005645e9-ff5b-494d-bc93-f9048a9e5c7d tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:55.860222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 825/1656] 10.222.0.75 () {54 vars in 912 bytes} [Tue May 17 15:41:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:41:55.875295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202ff9d-36f3-44d6-be29-757690114cec None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:55.876021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202ff9d-36f3-44d6-be29-757690114cec None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:55.876486 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202ff9d-36f3-44d6-be29-757690114cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:55.939154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d202ff9d-36f3-44d6-be29-757690114cec None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:55.948226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d202ff9d-36f3-44d6-be29-757690114cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:56.018441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005645e9-ff5b-494d-bc93-f9048a9e5c7d tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:56.049485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324005e2-175e-4122-aadc-9017b2362ae9 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd45c6799124027994ef3c8939410c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8079cea5dbf14e789cf2dfd6d9529beb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:56.050231 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324005e2-175e-4122-aadc-9017b2362ae9 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:56.050525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324005e2-175e-4122-aadc-9017b2362ae9 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:56.050810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324005e2-175e-4122-aadc-9017b2362ae9 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:56.051678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324005e2-175e-4122-aadc-9017b2362ae9 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:41:56.051860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324005e2-175e-4122-aadc-9017b2362ae9 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:56.061650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324005e2-175e-4122-aadc-9017b2362ae9 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:56.107802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 832/1657] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:41:56.159678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324005e2-175e-4122-aadc-9017b2362ae9 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:56.177537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324005e2-175e-4122-aadc-9017b2362ae9 tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:56.193972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd45c6799124027994ef3c8939410c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8079cea5dbf14e789cf2dfd6d9529beb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:56.194897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:56.195180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:56.195457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] PATH_INFO: `/v3/projects/ad83bd6704ae49f88551e6d45e3fc86e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:56.204821 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad83bd6704ae49f88551e6d45e3fc86e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:56.207127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: WARNING py.warnings [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:41:56.207127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: warnings.warn(msg) May 17 15:41:56.207127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: May 17 15:41:56.208395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:56.215074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 826/1658] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:41:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:56.227013 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202ff9d-36f3-44d6-be29-757690114cec None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:56.230564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d202ff9d-36f3-44d6-be29-757690114cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:56.398790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad83bd6704ae49f88551e6d45e3fc86e', 'request_id': 'req-25490b3b-158b-47ad-94db-281acb56f5db'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:56.419571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202ff9d-36f3-44d6-be29-757690114cec None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:56.453779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad83bd6704ae49f88551e6d45e3fc86e', 'request_id': 'req-25490b3b-158b-47ad-94db-281acb56f5db'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:56.489532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad83bd6704ae49f88551e6d45e3fc86e', 'request_id': 'req-25490b3b-158b-47ad-94db-281acb56f5db'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:56.509561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] The token cache is being invalidate because project ad83bd6704ae49f88551e6d45e3fc86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:41:56.510495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:56.513378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:56.523992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 833/1659] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:41:56 2022] DELETE /identity/v3/projects/ad83bd6704ae49f88551e6d45e3fc86e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:56.546129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22c0e889e1f842b2a6081f38aabd97ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:56.546984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:56.547448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:56.547928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:56.550433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:56.640254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:56.642543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:56.663954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 827/1660] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:57.201667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:57.203995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:57.229870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:57.236088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:57.415952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490b3b-158b-47ad-94db-281acb56f5db tempest-VolumeQuotaClassesTest-452324011 tempest-VolumeQuotaClassesTest-452324011-project-admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:57.436423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:57.437777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:57.437777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:57.438039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] PATH_INFO: `/v3/projects/1d9d2678724744c6850a20d91e9edfcb` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:57.487785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9d2678724744c6850a20d91e9edfcb)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:57.487785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:57.567747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9d2678724744c6850a20d91e9edfcb', 'request_id': 'req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:57.592576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9d2678724744c6850a20d91e9edfcb', 'request_id': 'req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:57.623650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9d2678724744c6850a20d91e9edfcb', 'request_id': 'req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:57.661151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] The token cache is being invalidate because project 1d9d2678724744c6850a20d91e9edfcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:41:57.661464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:57.664727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-18ff0b6e-5cd6-452f-9f6f-fedf561af21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:57.668830 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 834/1661] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:41:57 2022] DELETE /identity/v3/projects/1d9d2678724744c6850a20d91e9edfcb => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:57.672011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c596ef-d19e-482b-92a5-05581a8fc8a3 service glance] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:57.674986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732d977-174f-45a2-82f5-af0517e8bbc9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:57.680207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732d977-174f-45a2-82f5-af0517e8bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:57.681425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732d977-174f-45a2-82f5-af0517e8bbc9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:57.691733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 835/1662] 10.222.0.75 () {54 vars in 912 bytes} [Tue May 17 15:41:57 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:41:57.693801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732d977-174f-45a2-82f5-af0517e8bbc9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:57.695926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1732d977-174f-45a2-82f5-af0517e8bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:57.808555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732d977-174f-45a2-82f5-af0517e8bbc9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:57.821300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:57.823044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:57.824535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:57.825174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] PATH_INFO: `/v3/users/503424287a084e5891cb490238166e28` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:57.827678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] RBAC: Authorizing `identity:delete_user(user_id=503424287a084e5891cb490238166e28)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:57.834600 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:57.862077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:57.863720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:57.863875 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:57.864549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] PATH_INFO: `/v3/users/855af005a03a456baaac4c79f2906318` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:57.870352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855af005a03a456baaac4c79f2906318)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:57.871585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 15:41:57.871585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: warnings.warn(msg) May 17 15:41:57.871585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: May 17 15:41:57.873802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:57.958369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503424287a084e5891cb490238166e28'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.008891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503424287a084e5891cb490238166e28'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.010750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503424287a084e5891cb490238166e28'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.013979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503424287a084e5891cb490238166e28'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.035416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-013adc2f-7701-4fc2-9824-cc5cae5b642f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503424287a084e5891cb490238166e28'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.052149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855af005a03a456baaac4c79f2906318'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.074902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 836/1663] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:41:57 2022] DELETE /identity/v3/users/503424287a084e5891cb490238166e28 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:58.079007 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672dbf-3115-4ea1-b295-a3165b56ff64 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:58.079007 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672dbf-3115-4ea1-b295-a3165b56ff64 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:58.079281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672dbf-3115-4ea1-b295-a3165b56ff64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:58.111280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855af005a03a456baaac4c79f2906318'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.113745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855af005a03a456baaac4c79f2906318'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.139393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855af005a03a456baaac4c79f2906318'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.159827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c748d4b2-116b-4214-9134-e21c925c3305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855af005a03a456baaac4c79f2906318'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.173231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 828/1664] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:41:57 2022] DELETE /identity/v3/users/855af005a03a456baaac4c79f2906318 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:58.179387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4d18c-2876-4ebf-ae19-f27e2fd1705b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:58.179688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4d18c-2876-4ebf-ae19-f27e2fd1705b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:58.180530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4d18c-2876-4ebf-ae19-f27e2fd1705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:58.184152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3e672dbf-3115-4ea1-b295-a3165b56ff64 None None] MFA Rules not processed for user `03e9f522282644e2aad2eefba7509f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:58.187031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3e672dbf-3115-4ea1-b295-a3165b56ff64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:58.217521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e6b4d18c-2876-4ebf-ae19-f27e2fd1705b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:58.219132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e6b4d18c-2876-4ebf-ae19-f27e2fd1705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:58.320212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 829/1665] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:58.345363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 837/1666] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:58.371138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4d18c-2876-4ebf-ae19-f27e2fd1705b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:58.372911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e6b4d18c-2876-4ebf-ae19-f27e2fd1705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:58.398356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672dbf-3115-4ea1-b295-a3165b56ff64 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:58.400126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3e672dbf-3115-4ea1-b295-a3165b56ff64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:58.413532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4d18c-2876-4ebf-ae19-f27e2fd1705b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:58.426114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f1517-c4f8-4cc4-b79f-f90c512f7184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:58.426789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f1517-c4f8-4cc4-b79f-f90c512f7184 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:58.427072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f1517-c4f8-4cc4-b79f-f90c512f7184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:58.428150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f1517-c4f8-4cc4-b79f-f90c512f7184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:58.429347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672dbf-3115-4ea1-b295-a3165b56ff64 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:58.443618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:58.444525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:58.447071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:58.447419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] PATH_INFO: `/v3/users/f765820a65e34d0b9d19a602f022b278` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:58.451913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f765820a65e34d0b9d19a602f022b278)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:58.453562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f1517-c4f8-4cc4-b79f-f90c512f7184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:58.456484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:58.459768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f1517-c4f8-4cc4-b79f-f90c512f7184 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:58.492530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 830/1667] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:58.493403 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f1517-c4f8-4cc4-b79f-f90c512f7184 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:58.498092 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-643f1517-c4f8-4cc4-b79f-f90c512f7184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:58.520816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f1517-c4f8-4cc4-b79f-f90c512f7184 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:58.528824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:58.535086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:58.535586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:58.535945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] PATH_INFO: `/v3/users/526ae619a6ca4c38ba1ecbe9b284151a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:58.538468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=526ae619a6ca4c38ba1ecbe9b284151a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:58.540791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:58.588988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f765820a65e34d0b9d19a602f022b278'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.620677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f765820a65e34d0b9d19a602f022b278'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.622366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f765820a65e34d0b9d19a602f022b278'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.623353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f765820a65e34d0b9d19a602f022b278'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.630061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526ae619a6ca4c38ba1ecbe9b284151a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.639328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f765820a65e34d0b9d19a602f022b278'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.652860 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526ae619a6ca4c38ba1ecbe9b284151a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.654296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526ae619a6ca4c38ba1ecbe9b284151a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.668462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526ae619a6ca4c38ba1ecbe9b284151a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.670654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 838/1668] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:41:58 2022] DELETE /identity/v3/users/f765820a65e34d0b9d19a602f022b278 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:58.671762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:58.674901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:58.683305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e731bbf7-b5ef-4ac7-ba17-fa060df88e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526ae619a6ca4c38ba1ecbe9b284151a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:41:58.741307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 831/1669] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:41:58 2022] DELETE /identity/v3/users/526ae619a6ca4c38ba1ecbe9b284151a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:41:58.746095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042fc80-8168-44bb-a32d-ec4ff4959952 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:58.753980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042fc80-8168-44bb-a32d-ec4ff4959952 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:58.756664 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042fc80-8168-44bb-a32d-ec4ff4959952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:58.855513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b042fc80-8168-44bb-a32d-ec4ff4959952 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:58.856777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b042fc80-8168-44bb-a32d-ec4ff4959952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:58.929008 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd905b-3f84-45c6-89b7-7d15cb81f80c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:59.027239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:59.028183 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:59.028587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:59.028876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:59.040936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:59.044571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 832/1670] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:59.046028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f70b5-c4d3-4de0-8d8c-7756f86a8b58 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:59.048197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f70b5-c4d3-4de0-8d8c-7756f86a8b58 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:59.048493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f70b5-c4d3-4de0-8d8c-7756f86a8b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:59.067117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:59.071595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:59.091118 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9e3f70b5-c4d3-4de0-8d8c-7756f86a8b58 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:41:59.092421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9e3f70b5-c4d3-4de0-8d8c-7756f86a8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:59.093739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 839/1671] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:59.118175 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 833/1672] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:41:59.161915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:59.163536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:59.182154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bf652-c226-426c-910a-d7d176cb1ca9 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:59.187077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c46ba-ce6f-4b1b-9866-8a55a817a406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:59.187865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c46ba-ce6f-4b1b-9866-8a55a817a406 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:59.188214 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c46ba-ce6f-4b1b-9866-8a55a817a406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:59.189235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c46ba-ce6f-4b1b-9866-8a55a817a406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:59.207910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c46ba-ce6f-4b1b-9866-8a55a817a406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:59.209747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c46ba-ce6f-4b1b-9866-8a55a817a406 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:59.229273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 840/1673] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:41:59.399299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f70b5-c4d3-4de0-8d8c-7756f86a8b58 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:41:59.402266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9e3f70b5-c4d3-4de0-8d8c-7756f86a8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:41:59.426821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f70b5-c4d3-4de0-8d8c-7756f86a8b58 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:41:59.434605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf98e-f841-49ba-810c-8ed4c52c9441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:41:59.436975 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf98e-f841-49ba-810c-8ed4c52c9441 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:41:59.438130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf98e-f841-49ba-810c-8ed4c52c9441 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:41:59.438988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf98e-f841-49ba-810c-8ed4c52c9441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:41:59.468915 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bf98e-f841-49ba-810c-8ed4c52c9441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:41:59.472762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bf98e-f841-49ba-810c-8ed4c52c9441 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:41:59.501226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 834/1674] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:00.297190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c46ba-ce6f-4b1b-9866-8a55a817a406 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:00.300686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0e0c46ba-ce6f-4b1b-9866-8a55a817a406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:00.323524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c46ba-ce6f-4b1b-9866-8a55a817a406 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:00.330322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:00.331347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:00.331633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:00.331906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] PATH_INFO: `/v3/projects/fff0cdf39b5643d1bc546c163773df6e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:00.333427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff0cdf39b5643d1bc546c163773df6e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:00.335720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:00.438694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff0cdf39b5643d1bc546c163773df6e', 'request_id': 'req-7f0882b5-5a39-48cb-950d-10bef049d575'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.446985 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff0cdf39b5643d1bc546c163773df6e', 'request_id': 'req-7f0882b5-5a39-48cb-950d-10bef049d575'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.477341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff0cdf39b5643d1bc546c163773df6e', 'request_id': 'req-7f0882b5-5a39-48cb-950d-10bef049d575'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.515412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b93af-fbef-41de-af72-5e425f67f840 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:00.515412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b93af-fbef-41de-af72-5e425f67f840 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:00.515412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b93af-fbef-41de-af72-5e425f67f840 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:00.515412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 835/1675] 10.222.0.75 () {54 vars in 960 bytes} [Tue May 17 15:42:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:42:00.522912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] The token cache is being invalidate because project fff0cdf39b5643d1bc546c163773df6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:00.523446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.523860 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d06c6-ed3a-444d-9ab2-c1505ecaee1c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:00.524226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d06c6-ed3a-444d-9ab2-c1505ecaee1c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:00.524603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.526133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d06c6-ed3a-444d-9ab2-c1505ecaee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:00.528189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 841/1676] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:00 2022] DELETE /identity/v3/projects/fff0cdf39b5643d1bc546c163773df6e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:00.531724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:00.533532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:00.574524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-465d06c6-ed3a-444d-9ab2-c1505ecaee1c None None] MFA Rules not processed for user `8614649160fb4bcca89b18ceeb6c0785`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:00.579150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-465d06c6-ed3a-444d-9ab2-c1505ecaee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:00.701123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0882b5-5a39-48cb-950d-10bef049d575 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:00.714430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:00.715710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:00.716213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:00.716654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] PATH_INFO: `/v3/users/899c3defe43c40f7a0310f541eb08ae7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:00.718162 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899c3defe43c40f7a0310f541eb08ae7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:00.722321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:00.795475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 836/1677] 10.222.0.75 () {58 vars in 1057 bytes} [Tue May 17 15:42:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:00.802759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d06c6-ed3a-444d-9ab2-c1505ecaee1c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:00.817415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899c3defe43c40f7a0310f541eb08ae7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.821294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d06c6-ed3a-444d-9ab2-c1505ecaee1c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:00.839276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:00.839971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:00.840057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899c3defe43c40f7a0310f541eb08ae7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.840241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:00.840516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:00.842189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899c3defe43c40f7a0310f541eb08ae7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.844122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899c3defe43c40f7a0310f541eb08ae7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.846162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:00.868637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f51b748f-4d7b-4b24-9058-72a58cf45273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899c3defe43c40f7a0310f541eb08ae7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:00.875536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:00.877169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:00.902737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 842/1678] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:00 2022] DELETE /identity/v3/users/899c3defe43c40f7a0310f541eb08ae7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:00.904567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 837/1679] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:42:01.103317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9b5b-c1cf-49ad-b398-254e3f06ba16 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:01.103644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9b5b-c1cf-49ad-b398-254e3f06ba16 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:01.103926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9b5b-c1cf-49ad-b398-254e3f06ba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:01.148733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0fcf9b5b-c1cf-49ad-b398-254e3f06ba16 None None] MFA Rules not processed for user `2e4972b781b043f69740342fde4efa73`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:01.150797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0fcf9b5b-c1cf-49ad-b398-254e3f06ba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:01.270695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 843/1680] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:01.276913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:01.281561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:01.320361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf9b5b-c1cf-49ad-b398-254e3f06ba16 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:01.324380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0fcf9b5b-c1cf-49ad-b398-254e3f06ba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:01.498669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab6e88-6595-4972-a632-91cfd1791165 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:01.524672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf9b5b-c1cf-49ad-b398-254e3f06ba16 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:01.530252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:01.531113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:01.531396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:01.531670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] PATH_INFO: `/v3/projects/6921a8fdfe4d4c06b69a31392ae2dcbf` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:01.534213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6921a8fdfe4d4c06b69a31392ae2dcbf)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:01.536169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:01.654615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6921a8fdfe4d4c06b69a31392ae2dcbf', 'request_id': 'req-f9b05e9b-cad8-4c7e-9198-be4719e82646'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:01.668779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6921a8fdfe4d4c06b69a31392ae2dcbf', 'request_id': 'req-f9b05e9b-cad8-4c7e-9198-be4719e82646'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:01.693700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6921a8fdfe4d4c06b69a31392ae2dcbf', 'request_id': 'req-f9b05e9b-cad8-4c7e-9198-be4719e82646'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:01.709476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] The token cache is being invalidate because project 6921a8fdfe4d4c06b69a31392ae2dcbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:01.709780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:01.711449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:01.715960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 844/1681] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:01 2022] DELETE /identity/v3/projects/6921a8fdfe4d4c06b69a31392ae2dcbf => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:01.716910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:01.720105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:01.725717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:01.727773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:01.728204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:01.729859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:01.732734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:01.765597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:01.765597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:01.790740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 838/1682] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:01.792716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:01.794119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:01.857184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172845d-7657-4ea8-a07a-9233be376ff3 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:01.874717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b05e9b-cad8-4c7e-9198-be4719e82646 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:01.889658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:01.892592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:01.895204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:01.896777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] PATH_INFO: `/v3/projects/968ff1a7ccb34504a91156845726c416` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:01.897631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:01.898613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:01.899640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:01.899928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] PATH_INFO: `/v3/projects/03e2126ec37242119dfbe2032df1dfd0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:01.905447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=968ff1a7ccb34504a91156845726c416)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:01.906224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e2126ec37242119dfbe2032df1dfd0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:01.910584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:01.919012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:02.105079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968ff1a7ccb34504a91156845726c416', 'request_id': 'req-b50676cd-f899-464f-acaf-7a5be781fb3c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.105581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e2126ec37242119dfbe2032df1dfd0', 'request_id': 'req-22e1a767-263d-44d4-86db-454e2a1647cf'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.121969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e2126ec37242119dfbe2032df1dfd0', 'request_id': 'req-22e1a767-263d-44d4-86db-454e2a1647cf'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.131679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968ff1a7ccb34504a91156845726c416', 'request_id': 'req-b50676cd-f899-464f-acaf-7a5be781fb3c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.141023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e2126ec37242119dfbe2032df1dfd0', 'request_id': 'req-22e1a767-263d-44d4-86db-454e2a1647cf'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.168089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968ff1a7ccb34504a91156845726c416', 'request_id': 'req-b50676cd-f899-464f-acaf-7a5be781fb3c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.198662 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] The token cache is being invalidate because project 968ff1a7ccb34504a91156845726c416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:02.198965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.203571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b50676cd-f899-464f-acaf-7a5be781fb3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.206994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 839/1683] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:01 2022] DELETE /identity/v3/projects/968ff1a7ccb34504a91156845726c416 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:02.207678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] The token cache is being invalidate because project 03e2126ec37242119dfbe2032df1dfd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:02.207678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.209105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.214970 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9dac7-5ffb-4229-afe8-b2d2acc9f0b6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:02.216379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9dac7-5ffb-4229-afe8-b2d2acc9f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:02.216622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9dac7-5ffb-4229-afe8-b2d2acc9f0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:02.234109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 845/1684] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:01 2022] DELETE /identity/v3/projects/03e2126ec37242119dfbe2032df1dfd0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:02.234109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:02.237643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:02.299099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d5e9dac7-5ffb-4229-afe8-b2d2acc9f0b6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:02.300354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d5e9dac7-5ffb-4229-afe8-b2d2acc9f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:02.426514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1a767-263d-44d4-86db-454e2a1647cf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:02.488004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 840/1685] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:02.491186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1244c-6594-4a68-8746-1e6251188475 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:02.491475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1244c-6594-4a68-8746-1e6251188475 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:02.493616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1244c-6594-4a68-8746-1e6251188475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:02.520968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a0c1244c-6594-4a68-8746-1e6251188475 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:02.522962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a0c1244c-6594-4a68-8746-1e6251188475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:02.534158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 841/1686] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:02.535829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f4763-e186-471d-81eb-4739d2878972 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:02.536283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f4763-e186-471d-81eb-4739d2878972 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:02.536713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f4763-e186-471d-81eb-4739d2878972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:02.577906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b22f4763-e186-471d-81eb-4739d2878972 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:02.581369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b22f4763-e186-471d-81eb-4739d2878972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:02.584405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:02.585437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:02.587171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:02.587440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] PATH_INFO: `/v3/users/0fd45c6799124027994ef3c8939410c5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:02.593121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd45c6799124027994ef3c8939410c5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:02.595916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:02.596131 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 842/1687] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:02.600364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc489a-2328-4f5e-b7ad-b7dee39a1bf8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:02.600898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc489a-2328-4f5e-b7ad-b7dee39a1bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:02.604018 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc489a-2328-4f5e-b7ad-b7dee39a1bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:02.653858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-eadc489a-2328-4f5e-b7ad-b7dee39a1bf8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:02.656987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eadc489a-2328-4f5e-b7ad-b7dee39a1bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:02.681765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 843/1688] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:02.681765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc489a-2328-4f5e-b7ad-b7dee39a1bf8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:02.698958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd45c6799124027994ef3c8939410c5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.704395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc489a-2328-4f5e-b7ad-b7dee39a1bf8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:02.714765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd45c6799124027994ef3c8939410c5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.716283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd45c6799124027994ef3c8939410c5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.717671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd45c6799124027994ef3c8939410c5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.727711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd45c6799124027994ef3c8939410c5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:02.729711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:02.731084 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:02.731515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:02.731928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:02.733088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:42:02.733561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:02.735414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:02.757842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 844/1689] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:42:02.759160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:02.765018 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:02.767250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 846/1690] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:02 2022] DELETE /identity/v3/users/0fd45c6799124027994ef3c8939410c5 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:02.767878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:02.770098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:02.801602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00940a-95f9-4c6e-bed3-2ca66cca1688 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:02.885284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4740c-e8b4-453d-a87a-5985b077bb31 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:02.894019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7be1e-1c82-4a74-8fe8-1feda689a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:02.894793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7be1e-1c82-4a74-8fe8-1feda689a2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:02.895266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7be1e-1c82-4a74-8fe8-1feda689a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:02.895562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7be1e-1c82-4a74-8fe8-1feda689a2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:02.896473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7be1e-1c82-4a74-8fe8-1feda689a2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:02.901734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7be1e-1c82-4a74-8fe8-1feda689a2cb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:02.960693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a786df3-dff0-4d3c-a5a1-c772d1b09ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:02.961634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a786df3-dff0-4d3c-a5a1-c772d1b09ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:02.962094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a786df3-dff0-4d3c-a5a1-c772d1b09ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:02.962506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a786df3-dff0-4d3c-a5a1-c772d1b09ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:02.964008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a786df3-dff0-4d3c-a5a1-c772d1b09ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:42:02.964508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a786df3-dff0-4d3c-a5a1-c772d1b09ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:02.966467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a786df3-dff0-4d3c-a5a1-c772d1b09ffe admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:02.987748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 847/1691] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:02 2022] POST /identity/v3/projects => generated 405 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:03.003943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7be1e-1c82-4a74-8fe8-1feda689a2cb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:03.017504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 845/1692] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:42:03.018810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a786df3-dff0-4d3c-a5a1-c772d1b09ffe admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:03.049350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a786df3-dff0-4d3c-a5a1-c772d1b09ffe admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:03.203670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7be1e-1c82-4a74-8fe8-1feda689a2cb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:03.220431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93d706-9ea1-453f-918c-23ab67aeb0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:03.225779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93d706-9ea1-453f-918c-23ab67aeb0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:03.226533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93d706-9ea1-453f-918c-23ab67aeb0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:03.226828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93d706-9ea1-453f-918c-23ab67aeb0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:03.235482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93d706-9ea1-453f-918c-23ab67aeb0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:03.243185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379028-0b09-421a-97d8-26650798e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:03.243444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379028-0b09-421a-97d8-26650798e0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:03.243709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379028-0b09-421a-97d8-26650798e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:03.243982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379028-0b09-421a-97d8-26650798e0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:03.244896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93d706-9ea1-453f-918c-23ab67aeb0a2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:03.245362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a379028-0b09-421a-97d8-26650798e0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:03.249294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a379028-0b09-421a-97d8-26650798e0a5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:03.310495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 848/1693] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:02 2022] POST /identity/v3/users => generated 303 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:03.311742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93d706-9ea1-453f-918c-23ab67aeb0a2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:03.317536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5d93d706-9ea1-453f-918c-23ab67aeb0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:03.329174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 846/1694] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:03 2022] POST /identity/v3/projects => generated 375 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:42:03.330372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379028-0b09-421a-97d8-26650798e0a5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:03.368371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93d706-9ea1-453f-918c-23ab67aeb0a2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:03.501307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:03.502229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:03.502521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:03.502823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] PATH_INFO: `/v3/projects/7447666cb0294be18bf08101bdef9168` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:03.507540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7447666cb0294be18bf08101bdef9168)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:03.514701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:03.533011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379028-0b09-421a-97d8-26650798e0a5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:03.542416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27eeaa-c8a4-4bf1-b8e1-9a15a0eebd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:03.543354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27eeaa-c8a4-4bf1-b8e1-9a15a0eebd66 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:03.543634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27eeaa-c8a4-4bf1-b8e1-9a15a0eebd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:03.543907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27eeaa-c8a4-4bf1-b8e1-9a15a0eebd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:03.544687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27eeaa-c8a4-4bf1-b8e1-9a15a0eebd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:03.552123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27eeaa-c8a4-4bf1-b8e1-9a15a0eebd66 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:03.596957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 847/1695] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:03.600086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27eeaa-c8a4-4bf1-b8e1-9a15a0eebd66 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:03.636949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27eeaa-c8a4-4bf1-b8e1-9a15a0eebd66 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:03.665927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7447666cb0294be18bf08101bdef9168', 'request_id': 'req-d77dff51-f005-4349-899b-b532302ce7d3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:03.679637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7447666cb0294be18bf08101bdef9168', 'request_id': 'req-d77dff51-f005-4349-899b-b532302ce7d3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:03.701215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7447666cb0294be18bf08101bdef9168', 'request_id': 'req-d77dff51-f005-4349-899b-b532302ce7d3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:03.729237 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] The token cache is being invalidate because project 7447666cb0294be18bf08101bdef9168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:03.745894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:03.750819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d77dff51-f005-4349-899b-b532302ce7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:03.757022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 849/1696] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:03 2022] DELETE /identity/v3/projects/7447666cb0294be18bf08101bdef9168 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:03.758590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf765c05-7daf-43ca-be29-9e83c44b5d03 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:03.758878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf765c05-7daf-43ca-be29-9e83c44b5d03 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:03.759164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf765c05-7daf-43ca-be29-9e83c44b5d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:03.793024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634edd1c-c2db-4249-b63b-b97542c81f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:03.795104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634edd1c-c2db-4249-b63b-b97542c81f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:03.797796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634edd1c-c2db-4249-b63b-b97542c81f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:03.798967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634edd1c-c2db-4249-b63b-b97542c81f84 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:03.800242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634edd1c-c2db-4249-b63b-b97542c81f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:03.805244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634edd1c-c2db-4249-b63b-b97542c81f84 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:03.844211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 848/1697] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:03 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:03.844211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634edd1c-c2db-4249-b63b-b97542c81f84 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:03.845730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-634edd1c-c2db-4249-b63b-b97542c81f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:03.855969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cf765c05-7daf-43ca-be29-9e83c44b5d03 None None] MFA Rules not processed for user `b40c7b11fff443fa8c78e8647703e230`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:03.857224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cf765c05-7daf-43ca-be29-9e83c44b5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:03.886988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634edd1c-c2db-4249-b63b-b97542c81f84 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:03.894663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3041aa-c60e-40a2-a569-4c5dd295934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:03.896041 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3041aa-c60e-40a2-a569-4c5dd295934e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:03.896483 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3041aa-c60e-40a2-a569-4c5dd295934e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:03.897359 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3041aa-c60e-40a2-a569-4c5dd295934e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:03.898595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3041aa-c60e-40a2-a569-4c5dd295934e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:03.901384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3041aa-c60e-40a2-a569-4c5dd295934e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:03.938871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 849/1698] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:03.943738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339f1b-5d38-4078-80df-7c9854fdf635 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:03.944033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339f1b-5d38-4078-80df-7c9854fdf635 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:03.944315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339f1b-5d38-4078-80df-7c9854fdf635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:04.008499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2e339f1b-5d38-4078-80df-7c9854fdf635 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:04.010430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2e339f1b-5d38-4078-80df-7c9854fdf635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:04.050438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 850/1699] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:04.050438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e339f1b-5d38-4078-80df-7c9854fdf635 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:04.051348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2e339f1b-5d38-4078-80df-7c9854fdf635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:04.098798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e339f1b-5d38-4078-80df-7c9854fdf635 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:04.122550 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad0866-6981-4fd4-807a-ae63f8ddf6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:04.124298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad0866-6981-4fd4-807a-ae63f8ddf6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:04.124586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad0866-6981-4fd4-807a-ae63f8ddf6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:04.124863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad0866-6981-4fd4-807a-ae63f8ddf6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:04.126766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad0866-6981-4fd4-807a-ae63f8ddf6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:04.128404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad0866-6981-4fd4-807a-ae63f8ddf6dc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:04.162731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 850/1700] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:04.172573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf765c05-7daf-43ca-be29-9e83c44b5d03 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:04.172732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 851/1701] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:04.172732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7490d2-ca3d-4c63-ac02-38ff6e606f92 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:04.172732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7490d2-ca3d-4c63-ac02-38ff6e606f92 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:04.172732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7490d2-ca3d-4c63-ac02-38ff6e606f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:04.222020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf765c05-7daf-43ca-be29-9e83c44b5d03 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:04.254318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da11300-d9c5-4bfb-a669-7682698ba272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:04.255265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da11300-d9c5-4bfb-a669-7682698ba272 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:04.255548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da11300-d9c5-4bfb-a669-7682698ba272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:04.255830 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da11300-d9c5-4bfb-a669-7682698ba272 admin admin] PATH_INFO: `/v3/projects/57d6debc5607465899ca7468dc207367/users/6dc90f9537f6480eb74cba57161b8476/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:04.257625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2a7490d2-ca3d-4c63-ac02-38ff6e606f92 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:04.258890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a7490d2-ca3d-4c63-ac02-38ff6e606f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:04.295990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 852/1702] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:04.296265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da11300-d9c5-4bfb-a669-7682698ba272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d6debc5607465899ca7468dc207367, user_id=6dc90f9537f6480eb74cba57161b8476, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:04.296582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7490d2-ca3d-4c63-ac02-38ff6e606f92 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:04.299640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a7490d2-ca3d-4c63-ac02-38ff6e606f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:04.306286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da11300-d9c5-4bfb-a669-7682698ba272 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:04.325376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7490d2-ca3d-4c63-ac02-38ff6e606f92 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:04.339411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 851/1703] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:04 2022] PUT /identity/v3/projects/57d6debc5607465899ca7468dc207367/users/6dc90f9537f6480eb74cba57161b8476/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:04.339411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da11300-d9c5-4bfb-a669-7682698ba272 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:04.473380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da11300-d9c5-4bfb-a669-7682698ba272 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:04.489836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80845-9262-4485-971b-a87303b6cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:04.491274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80845-9262-4485-971b-a87303b6cf82 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:04.491882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80845-9262-4485-971b-a87303b6cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:04.492310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80845-9262-4485-971b-a87303b6cf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:04.493652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80845-9262-4485-971b-a87303b6cf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:04.495953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80845-9262-4485-971b-a87303b6cf82 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:04.522945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 852/1704] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:04.524163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434707-24ac-4b49-b16a-24102a92a964 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:04.524306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:04.524432 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434707-24ac-4b49-b16a-24102a92a964 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:04.524726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434707-24ac-4b49-b16a-24102a92a964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:04.525189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:04.525515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:04.525787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] PATH_INFO: `/v3/projects/8079cea5dbf14e789cf2dfd6d9529beb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:04.533107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8079cea5dbf14e789cf2dfd6d9529beb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:04.535814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:04.569384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1a434707-24ac-4b49-b16a-24102a92a964 None None] MFA Rules not processed for user `b40c7b11fff443fa8c78e8647703e230`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:04.570847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1a434707-24ac-4b49-b16a-24102a92a964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:04.713567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8079cea5dbf14e789cf2dfd6d9529beb', 'request_id': 'req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:04.731233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8079cea5dbf14e789cf2dfd6d9529beb', 'request_id': 'req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:04.748337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8079cea5dbf14e789cf2dfd6d9529beb', 'request_id': 'req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:04.764145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 853/1705] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:04.764870 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a434707-24ac-4b49-b16a-24102a92a964 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:04.769620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] The token cache is being invalidate because project 8079cea5dbf14e789cf2dfd6d9529beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:04.776385 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:04.777421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf6bf8f5-a1a8-4258-94c3-ef4268bb6953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:04.785279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 853/1706] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:04 2022] DELETE /identity/v3/projects/8079cea5dbf14e789cf2dfd6d9529beb => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:04.785279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00b794-7a8a-428f-b84f-503a9656fdd0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:04.785779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00b794-7a8a-428f-b84f-503a9656fdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:04.786093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00b794-7a8a-428f-b84f-503a9656fdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:04.790533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a434707-24ac-4b49-b16a-24102a92a964 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:04.826355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3d00b794-7a8a-428f-b84f-503a9656fdd0 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:04.827759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3d00b794-7a8a-428f-b84f-503a9656fdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:04.960504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:04.961407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:04.961754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:04.962165 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:04.963732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:42:04.964144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:04.967969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:04.971715 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 854/1707] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:04.972966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077a2ef-b83b-47cb-9ff6-95d45021c7c5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:04.973261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077a2ef-b83b-47cb-9ff6-95d45021c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:04.973540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077a2ef-b83b-47cb-9ff6-95d45021c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:05.004403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 854/1708] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:42:05.009191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:05.012549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.020783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2077a2ef-b83b-47cb-9ff6-95d45021c7c5 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:05.022024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2077a2ef-b83b-47cb-9ff6-95d45021c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.033702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d564064-8cd2-4c44-95e4-7003cc0a5b9e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:05.046484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee0e00-e660-4aee-b070-f55fb102dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:05.047835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee0e00-e660-4aee-b070-f55fb102dcdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:05.048219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee0e00-e660-4aee-b070-f55fb102dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:05.048600 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee0e00-e660-4aee-b070-f55fb102dcdd admin admin] PATH_INFO: `/v3/projects/d3379e9ffb88408781ad3728b8d76895/users/ff46ececf6a148268d33007b19dbc249/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:05.073116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee0e00-e660-4aee-b070-f55fb102dcdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3379e9ffb88408781ad3728b8d76895, user_id=ff46ececf6a148268d33007b19dbc249, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:05.080796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee0e00-e660-4aee-b070-f55fb102dcdd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:05.122932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 855/1709] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:05 2022] PUT /identity/v3/projects/d3379e9ffb88408781ad3728b8d76895/users/ff46ececf6a148268d33007b19dbc249/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:05.123994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee0e00-e660-4aee-b070-f55fb102dcdd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:05.125927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-97ee0e00-e660-4aee-b070-f55fb102dcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.194117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 855/1710] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:05.200037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46fd21-2476-496f-8e19-e25abf235342 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:05.200328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46fd21-2476-496f-8e19-e25abf235342 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:05.200609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46fd21-2476-496f-8e19-e25abf235342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:05.241840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-eb46fd21-2476-496f-8e19-e25abf235342 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:05.243196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eb46fd21-2476-496f-8e19-e25abf235342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.249220 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee0e00-e660-4aee-b070-f55fb102dcdd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:05.262711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:05.263944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:05.265741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:05.266634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:05.272094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.349742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 856/1711] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:05.350863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46fd21-2476-496f-8e19-e25abf235342 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:05.353431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eb46fd21-2476-496f-8e19-e25abf235342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.367306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46fd21-2476-496f-8e19-e25abf235342 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:05.374708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1a1e6-fd81-4576-a1e7-87dba651c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:05.375688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a1e6-fd81-4576-a1e7-87dba651c3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:05.376113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a1e6-fd81-4576-a1e7-87dba651c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:05.376536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a1e6-fd81-4576-a1e7-87dba651c3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:05.377540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1a1e6-fd81-4576-a1e7-87dba651c3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:05.383427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1a1e6-fd81-4576-a1e7-87dba651c3c4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:05.393552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:05.400094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:05.420553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 856/1712] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:05.421887 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:05.423665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.426778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 857/1713] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:05 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:05.428165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f354ad-1a05-4b5c-876b-44fc87162a28 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:05.428451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f354ad-1a05-4b5c-876b-44fc87162a28 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:05.428729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f354ad-1a05-4b5c-876b-44fc87162a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:05.482951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-67f354ad-1a05-4b5c-876b-44fc87162a28 None None] MFA Rules not processed for user `ff46ececf6a148268d33007b19dbc249`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:05.484865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-67f354ad-1a05-4b5c-876b-44fc87162a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.597329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49c381-680b-4494-bc89-f903e21c773a service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:05.652559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 858/1714] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:05.653149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94648a38-b555-4e21-993c-52c07f7bba8f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:05.653417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94648a38-b555-4e21-993c-52c07f7bba8f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:05.653695 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94648a38-b555-4e21-993c-52c07f7bba8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:05.720515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d0b72-0e0d-4e7d-b19d-30bc7b7f98a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:05.721327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d0b72-0e0d-4e7d-b19d-30bc7b7f98a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:05.721732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d0b72-0e0d-4e7d-b19d-30bc7b7f98a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:05.722346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d0b72-0e0d-4e7d-b19d-30bc7b7f98a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:05.737709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-94648a38-b555-4e21-993c-52c07f7bba8f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:05.747345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-94648a38-b555-4e21-993c-52c07f7bba8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.804459 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d0b72-0e0d-4e7d-b19d-30bc7b7f98a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:05.806114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d0b72-0e0d-4e7d-b19d-30bc7b7f98a8 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:05.823687 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 857/1715] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:05.824806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d0b72-0e0d-4e7d-b19d-30bc7b7f98a8 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:05.826425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-258d0b72-0e0d-4e7d-b19d-30bc7b7f98a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:05.942302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d0b72-0e0d-4e7d-b19d-30bc7b7f98a8 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:05.947010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 859/1716] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:05.949508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ad23b-1eff-4619-909f-c448d6c27bb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:05.950422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ad23b-1eff-4619-909f-c448d6c27bb2 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:05.951240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ad23b-1eff-4619-909f-c448d6c27bb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:05.951630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ad23b-1eff-4619-909f-c448d6c27bb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:05.954234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94648a38-b555-4e21-993c-52c07f7bba8f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:05.991794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94648a38-b555-4e21-993c-52c07f7bba8f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.009768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7d2c-c479-4291-a30b-da89332a6a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.010491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7d2c-c479-4291-a30b-da89332a6a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.013864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7d2c-c479-4291-a30b-da89332a6a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.014214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7d2c-c479-4291-a30b-da89332a6a86 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.014961 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd7d2c-c479-4291-a30b-da89332a6a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.016928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd7d2c-c479-4291-a30b-da89332a6a86 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.080699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ad23b-1eff-4619-909f-c448d6c27bb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.082384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 860/1717] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:05 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:06.083381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7d2c-c479-4291-a30b-da89332a6a86 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.085110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ad23b-1eff-4619-909f-c448d6c27bb2 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.113059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 858/1718] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:42:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:42:06.118119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ad23b-1eff-4619-909f-c448d6c27bb2 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.136348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7d2c-c479-4291-a30b-da89332a6a86 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.149941 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ad23b-1eff-4619-909f-c448d6c27bb2 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.153576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356af21-a2c1-4de9-8285-0c9279326628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.158160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356af21-a2c1-4de9-8285-0c9279326628 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.158562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356af21-a2c1-4de9-8285-0c9279326628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.164468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356af21-a2c1-4de9-8285-0c9279326628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.168153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356af21-a2c1-4de9-8285-0c9279326628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.179225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70bb14-bf6e-449e-b5e6-dc3defb22223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.181336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356af21-a2c1-4de9-8285-0c9279326628 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.182819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70bb14-bf6e-449e-b5e6-dc3defb22223 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.185342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70bb14-bf6e-449e-b5e6-dc3defb22223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.188310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70bb14-bf6e-449e-b5e6-dc3defb22223 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.190024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70bb14-bf6e-449e-b5e6-dc3defb22223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:42:06.194545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70bb14-bf6e-449e-b5e6-dc3defb22223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.201321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70bb14-bf6e-449e-b5e6-dc3defb22223 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.284849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 859/1719] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:42:06.286304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70bb14-bf6e-449e-b5e6-dc3defb22223 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.301176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 861/1720] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:06 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:06.302989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356af21-a2c1-4de9-8285-0c9279326628 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.348432 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70bb14-bf6e-449e-b5e6-dc3defb22223 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.453759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356af21-a2c1-4de9-8285-0c9279326628 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.459503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddbad7-dc6d-4953-a7bf-34c4738d235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.460312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddbad7-dc6d-4953-a7bf-34c4738d235b admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.460454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddbad7-dc6d-4953-a7bf-34c4738d235b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.460705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddbad7-dc6d-4953-a7bf-34c4738d235b admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.461879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddbad7-dc6d-4953-a7bf-34c4738d235b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.464133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddbad7-dc6d-4953-a7bf-34c4738d235b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.529512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 862/1721] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:06 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:06.532340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddbad7-dc6d-4953-a7bf-34c4738d235b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.575694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717ed4e-cf95-4e74-888c-7e1221c9e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.578818 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717ed4e-cf95-4e74-888c-7e1221c9e078 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.586804 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717ed4e-cf95-4e74-888c-7e1221c9e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.588340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717ed4e-cf95-4e74-888c-7e1221c9e078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.589284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717ed4e-cf95-4e74-888c-7e1221c9e078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.599899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717ed4e-cf95-4e74-888c-7e1221c9e078 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.627893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 860/1722] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:06.629123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717ed4e-cf95-4e74-888c-7e1221c9e078 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.649619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717ed4e-cf95-4e74-888c-7e1221c9e078 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.713309 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddbad7-dc6d-4953-a7bf-34c4738d235b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.731341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe036b3-98e8-4c76-b235-e8885cc28d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.732035 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe036b3-98e8-4c76-b235-e8885cc28d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.732323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe036b3-98e8-4c76-b235-e8885cc28d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.732600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe036b3-98e8-4c76-b235-e8885cc28d98 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.733687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe036b3-98e8-4c76-b235-e8885cc28d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.748020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe036b3-98e8-4c76-b235-e8885cc28d98 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.812167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 863/1723] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:06 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:06.813241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe036b3-98e8-4c76-b235-e8885cc28d98 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.826041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47136631-0eb9-4329-9e3b-921480fc6a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.829914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47136631-0eb9-4329-9e3b-921480fc6a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.832265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47136631-0eb9-4329-9e3b-921480fc6a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.835598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47136631-0eb9-4329-9e3b-921480fc6a47 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.839356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe036b3-98e8-4c76-b235-e8885cc28d98 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.839604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47136631-0eb9-4329-9e3b-921480fc6a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.852837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47136631-0eb9-4329-9e3b-921480fc6a47 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.852965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fbdb8-cbd1-4715-a679-755e9fb837b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.854379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fbdb8-cbd1-4715-a679-755e9fb837b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.854755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fbdb8-cbd1-4715-a679-755e9fb837b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.854993 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fbdb8-cbd1-4715-a679-755e9fb837b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.856391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fbdb8-cbd1-4715-a679-755e9fb837b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.858043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fbdb8-cbd1-4715-a679-755e9fb837b9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.889432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 864/1724] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:06.890577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fbdb8-cbd1-4715-a679-755e9fb837b9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.907762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 861/1725] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:06 2022] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:06.908419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47136631-0eb9-4329-9e3b-921480fc6a47 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.927095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fbdb8-cbd1-4715-a679-755e9fb837b9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.937301 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47136631-0eb9-4329-9e3b-921480fc6a47 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:06.940243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bad9d3-e8e9-41f3-9cfe-d53fd3c782fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.940932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad9d3-e8e9-41f3-9cfe-d53fd3c782fa admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.941219 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad9d3-e8e9-41f3-9cfe-d53fd3c782fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.941591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad9d3-e8e9-41f3-9cfe-d53fd3c782fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.942256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bad9d3-e8e9-41f3-9cfe-d53fd3c782fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:06.943864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bad9d3-e8e9-41f3-9cfe-d53fd3c782fa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:06.954743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc515a97-d828-4dbe-898b-3a2dc1780715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:06.955658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc515a97-d828-4dbe-898b-3a2dc1780715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:06.956018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc515a97-d828-4dbe-898b-3a2dc1780715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:06.956420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc515a97-d828-4dbe-898b-3a2dc1780715 admin admin] PATH_INFO: `/v3/projects/98fcc4cbda644a37a0a6870d2b235777/users/423e110304844507ba47e60710e628f0/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:06.970193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 865/1726] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:06.971375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bad9d3-e8e9-41f3-9cfe-d53fd3c782fa admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:06.990332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc515a97-d828-4dbe-898b-3a2dc1780715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98fcc4cbda644a37a0a6870d2b235777, user_id=423e110304844507ba47e60710e628f0, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:07.001198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc515a97-d828-4dbe-898b-3a2dc1780715 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:07.006846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bad9d3-e8e9-41f3-9cfe-d53fd3c782fa admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:07.033657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c845afe-c465-4a7e-b7c7-bee778a82b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:07.034767 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845afe-c465-4a7e-b7c7-bee778a82b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:07.035273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845afe-c465-4a7e-b7c7-bee778a82b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:07.035684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845afe-c465-4a7e-b7c7-bee778a82b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:07.036953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c845afe-c465-4a7e-b7c7-bee778a82b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:07.038164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 862/1727] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:06 2022] PUT /identity/v3/projects/98fcc4cbda644a37a0a6870d2b235777/users/423e110304844507ba47e60710e628f0/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:07.038972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc515a97-d828-4dbe-898b-3a2dc1780715 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:07.044926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c845afe-c465-4a7e-b7c7-bee778a82b34 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:07.094272 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 866/1728] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:07.102485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7813d-58b6-4d07-844c-f51bb471819a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:07.102787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7813d-58b6-4d07-844c-f51bb471819a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:07.103052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7813d-58b6-4d07-844c-f51bb471819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:07.211462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5dd7813d-58b6-4d07-844c-f51bb471819a None None] MFA Rules not processed for user `423e110304844507ba47e60710e628f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:07.212740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5dd7813d-58b6-4d07-844c-f51bb471819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:07.229163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc515a97-d828-4dbe-898b-3a2dc1780715 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:07.262875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417d93a-5524-4b48-9f49-204ca1a8a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:07.264359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417d93a-5524-4b48-9f49-204ca1a8a2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:07.264766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417d93a-5524-4b48-9f49-204ca1a8a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:07.264945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417d93a-5524-4b48-9f49-204ca1a8a2ab admin admin] PATH_INFO: `/v3/projects/0e2109de1dad4661977e967a9c8259de/users/5ef2f2c1955349feb33d93e00bedbdac/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:07.314840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417d93a-5524-4b48-9f49-204ca1a8a2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2109de1dad4661977e967a9c8259de, user_id=5ef2f2c1955349feb33d93e00bedbdac, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:07.317717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417d93a-5524-4b48-9f49-204ca1a8a2ab admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:07.387568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 863/1729] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:07 2022] PUT /identity/v3/projects/0e2109de1dad4661977e967a9c8259de/users/5ef2f2c1955349feb33d93e00bedbdac/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:07.387568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417d93a-5524-4b48-9f49-204ca1a8a2ab admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:07.455611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 867/1730] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:07.455611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7813d-58b6-4d07-844c-f51bb471819a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:07.491276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7813d-58b6-4d07-844c-f51bb471819a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:07.568262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417d93a-5524-4b48-9f49-204ca1a8a2ab admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:07.583321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fc397-9e9f-4d36-8855-063f684f3085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:07.584016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fc397-9e9f-4d36-8855-063f684f3085 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:07.584301 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fc397-9e9f-4d36-8855-063f684f3085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:07.584578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fc397-9e9f-4d36-8855-063f684f3085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:07.585312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fc397-9e9f-4d36-8855-063f684f3085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:07.586984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fc397-9e9f-4d36-8855-063f684f3085 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:07.615274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 864/1731] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:07.616161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fc397-9e9f-4d36-8855-063f684f3085 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:07.639645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fc397-9e9f-4d36-8855-063f684f3085 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:07.660009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a2bd-5978-4246-b0f2-49db33c4b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:07.660692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a2bd-5978-4246-b0f2-49db33c4b472 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:07.661117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a2bd-5978-4246-b0f2-49db33c4b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:07.661407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a2bd-5978-4246-b0f2-49db33c4b472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:07.662131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05a2bd-5978-4246-b0f2-49db33c4b472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:07.664807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05a2bd-5978-4246-b0f2-49db33c4b472 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:07.735399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 865/1732] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:07 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:07.735399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a2bd-5978-4246-b0f2-49db33c4b472 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:07.745037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00719f-6b7e-4a0b-88c5-0fc9993d40d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:07.745659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00719f-6b7e-4a0b-88c5-0fc9993d40d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:07.750741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00719f-6b7e-4a0b-88c5-0fc9993d40d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:07.751031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00719f-6b7e-4a0b-88c5-0fc9993d40d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:07.751844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00719f-6b7e-4a0b-88c5-0fc9993d40d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:07.753482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00719f-6b7e-4a0b-88c5-0fc9993d40d1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:07.793013 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 868/1733] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:07.796341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b4835-42b9-478c-9387-c42c6e2f3111 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:07.796910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b4835-42b9-478c-9387-c42c6e2f3111 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:07.797488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b4835-42b9-478c-9387-c42c6e2f3111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:07.874023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a2bd-5978-4246-b0f2-49db33c4b472 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:07.896411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24b7d-fcd7-4f73-8bf2-8369d59cfba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:07.897313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24b7d-fcd7-4f73-8bf2-8369d59cfba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:07.898198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24b7d-fcd7-4f73-8bf2-8369d59cfba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:07.898198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24b7d-fcd7-4f73-8bf2-8369d59cfba8 admin admin] PATH_INFO: `/v3/projects/5626351bec8943fab1d247bda1e21d35/users/78cd8409ae8843ed993387123167bd4a/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:07.918447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7a9b4835-42b9-478c-9387-c42c6e2f3111 None None] MFA Rules not processed for user `d099a8ecc77b4259aa30f227ae8f28ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:07.918447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7a9b4835-42b9-478c-9387-c42c6e2f3111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:07.956634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf24b7d-fcd7-4f73-8bf2-8369d59cfba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5626351bec8943fab1d247bda1e21d35, user_id=78cd8409ae8843ed993387123167bd4a, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:07.967131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf24b7d-fcd7-4f73-8bf2-8369d59cfba8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:08.018457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 866/1734] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:07 2022] PUT /identity/v3/projects/5626351bec8943fab1d247bda1e21d35/users/78cd8409ae8843ed993387123167bd4a/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:08.018457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24b7d-fcd7-4f73-8bf2-8369d59cfba8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:08.182351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 869/1735] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:08.183290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b4835-42b9-478c-9387-c42c6e2f3111 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:08.208395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b4835-42b9-478c-9387-c42c6e2f3111 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:08.280766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24b7d-fcd7-4f73-8bf2-8369d59cfba8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:08.309972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6db53-411e-4c73-aade-e05c59d893ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:08.310993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6db53-411e-4c73-aade-e05c59d893ac admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:08.310993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6db53-411e-4c73-aade-e05c59d893ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:08.311297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6db53-411e-4c73-aade-e05c59d893ac admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:08.311958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6db53-411e-4c73-aade-e05c59d893ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:08.323751 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6db53-411e-4c73-aade-e05c59d893ac admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:08.436717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45a6a-5d9a-45be-a3e3-e49d642361ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:08.437650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45a6a-5d9a-45be-a3e3-e49d642361ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:08.437917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45a6a-5d9a-45be-a3e3-e49d642361ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:08.438217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45a6a-5d9a-45be-a3e3-e49d642361ab admin admin] PATH_INFO: `/v3/projects/0e2109de1dad4661977e967a9c8259de/users/5ef2f2c1955349feb33d93e00bedbdac/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:08.442835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45a6a-5d9a-45be-a3e3-e49d642361ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2109de1dad4661977e967a9c8259de, user_id=5ef2f2c1955349feb33d93e00bedbdac, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:08.445513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45a6a-5d9a-45be-a3e3-e49d642361ab admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:08.454317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 867/1736] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:08 2022] POST /identity/v3/users => generated 303 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:08.461442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b9440-f0ef-49cc-9d13-29c3d5387ff2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:08.462472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b9440-f0ef-49cc-9d13-29c3d5387ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:08.467372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b9440-f0ef-49cc-9d13-29c3d5387ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:08.514030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 870/1737] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:08 2022] PUT /identity/v3/projects/0e2109de1dad4661977e967a9c8259de/users/5ef2f2c1955349feb33d93e00bedbdac/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:08.517123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c877182-cbb9-4ccc-a21d-9ebf5acef31b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:08.528452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c877182-cbb9-4ccc-a21d-9ebf5acef31b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:08.528669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c877182-cbb9-4ccc-a21d-9ebf5acef31b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:08.543871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 871/1738] 10.222.0.75 () {54 vars in 912 bytes} [Tue May 17 15:42:08 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:42:08.544940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c877182-cbb9-4ccc-a21d-9ebf5acef31b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:08.559004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0c877182-cbb9-4ccc-a21d-9ebf5acef31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:08.610426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-657b9440-f0ef-49cc-9d13-29c3d5387ff2 None None] MFA Rules not processed for user `78cd8409ae8843ed993387123167bd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:08.614841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-657b9440-f0ef-49cc-9d13-29c3d5387ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:08.831341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 868/1739] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:08.832536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b9440-f0ef-49cc-9d13-29c3d5387ff2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:08.869275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c877182-cbb9-4ccc-a21d-9ebf5acef31b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:08.878670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ba58e-a7e4-49ca-accc-56426693f990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:08.879337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba58e-a7e4-49ca-accc-56426693f990 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:08.879615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba58e-a7e4-49ca-accc-56426693f990 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:08.879892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba58e-a7e4-49ca-accc-56426693f990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:09.017453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b9440-f0ef-49cc-9d13-29c3d5387ff2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:09.030781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ba58e-a7e4-49ca-accc-56426693f990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:09.032391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ba58e-a7e4-49ca-accc-56426693f990 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:09.034759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e52eb-c6aa-4ed7-b9ca-a2fc88be1a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:09.036914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e52eb-c6aa-4ed7-b9ca-a2fc88be1a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:09.037361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e52eb-c6aa-4ed7-b9ca-a2fc88be1a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:09.037786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e52eb-c6aa-4ed7-b9ca-a2fc88be1a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:09.038746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e52eb-c6aa-4ed7-b9ca-a2fc88be1a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:09.041803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e52eb-c6aa-4ed7-b9ca-a2fc88be1a32 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:09.068565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 872/1740] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:09.074443 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 869/1741] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:09.077152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602123-c08d-47d6-97d4-80ee87ec0a99 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:09.077652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602123-c08d-47d6-97d4-80ee87ec0a99 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:09.079675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602123-c08d-47d6-97d4-80ee87ec0a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:09.086082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e124e38-c642-4d4c-b749-d32a7f9dd985 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:09.086767 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e124e38-c642-4d4c-b749-d32a7f9dd985 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:09.087054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e124e38-c642-4d4c-b749-d32a7f9dd985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:09.133619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d4602123-c08d-47d6-97d4-80ee87ec0a99 None None] MFA Rules not processed for user `03e9f522282644e2aad2eefba7509f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:09.139583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d4602123-c08d-47d6-97d4-80ee87ec0a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:09.208654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8e124e38-c642-4d4c-b749-d32a7f9dd985 None None] MFA Rules not processed for user `5ef2f2c1955349feb33d93e00bedbdac`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:09.212089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8e124e38-c642-4d4c-b749-d32a7f9dd985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:09.336959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 870/1742] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:09.339093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806187d0-d58f-44d3-814e-1f712e0e37f1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:09.345717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806187d0-d58f-44d3-814e-1f712e0e37f1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:09.346096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806187d0-d58f-44d3-814e-1f712e0e37f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:09.418405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-806187d0-d58f-44d3-814e-1f712e0e37f1 None None] MFA Rules not processed for user `2e4972b781b043f69740342fde4efa73`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:09.421641 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-806187d0-d58f-44d3-814e-1f712e0e37f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:09.467062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 873/1743] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:09.467062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e124e38-c642-4d4c-b749-d32a7f9dd985 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:09.507418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e124e38-c642-4d4c-b749-d32a7f9dd985 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:09.519693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd4b71-879b-4517-8efb-2935b4bc100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:09.520531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd4b71-879b-4517-8efb-2935b4bc100b admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:09.520839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd4b71-879b-4517-8efb-2935b4bc100b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:09.521114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd4b71-879b-4517-8efb-2935b4bc100b admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:09.521820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd4b71-879b-4517-8efb-2935b4bc100b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:09.523805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd4b71-879b-4517-8efb-2935b4bc100b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:09.591314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 874/1744] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:09 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:09.593716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd4b71-879b-4517-8efb-2935b4bc100b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:09.663166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 871/1745] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:09.664331 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6619a8-34eb-4d7c-a8fd-aade5d7eae19 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:09.664621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6619a8-34eb-4d7c-a8fd-aade5d7eae19 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:09.664900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6619a8-34eb-4d7c-a8fd-aade5d7eae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:09.704091 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dc6619a8-34eb-4d7c-a8fd-aade5d7eae19 None None] MFA Rules not processed for user `03e9f522282644e2aad2eefba7509f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:09.707101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dc6619a8-34eb-4d7c-a8fd-aade5d7eae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:09.714853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd4b71-879b-4517-8efb-2935b4bc100b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:09.723182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c294055-8ce0-42bb-917e-98a64bfe9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:09.724824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c294055-8ce0-42bb-917e-98a64bfe9460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:09.725647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c294055-8ce0-42bb-917e-98a64bfe9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:09.730660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c294055-8ce0-42bb-917e-98a64bfe9460 admin admin] PATH_INFO: `/v3/projects/509d939f811d497985b40861e50f1f60/users/ad319032bd1545259b38d7c6ba18d06c/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:09.767821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c294055-8ce0-42bb-917e-98a64bfe9460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509d939f811d497985b40861e50f1f60, user_id=ad319032bd1545259b38d7c6ba18d06c, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:09.772738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c294055-8ce0-42bb-917e-98a64bfe9460 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:09.804756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 875/1746] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:09 2022] PUT /identity/v3/projects/509d939f811d497985b40861e50f1f60/users/ad319032bd1545259b38d7c6ba18d06c/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:09.806194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c294055-8ce0-42bb-917e-98a64bfe9460 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:09.813225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2c294055-8ce0-42bb-917e-98a64bfe9460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:09.825832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 872/1747] 10.222.0.61 () {58 vars in 1015 bytes} [Tue May 17 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:09.826760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6619a8-34eb-4d7c-a8fd-aade5d7eae19 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:09.829954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dc6619a8-34eb-4d7c-a8fd-aade5d7eae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:09.956980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c294055-8ce0-42bb-917e-98a64bfe9460 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:09.972662 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc987a-6429-49c4-be82-dfdd637c9d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:09.975164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc987a-6429-49c4-be82-dfdd637c9d5e service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:09.976672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc987a-6429-49c4-be82-dfdd637c9d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:09.976967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc987a-6429-49c4-be82-dfdd637c9d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:09.997414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc987a-6429-49c4-be82-dfdd637c9d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:09.998925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc987a-6429-49c4-be82-dfdd637c9d5e service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:10.012589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6619a8-34eb-4d7c-a8fd-aade5d7eae19 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:10.047827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 876/1748] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:10.048954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d6e0d-47ac-4962-98a6-b411c75f16e4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:10.049251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d6e0d-47ac-4962-98a6-b411c75f16e4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:10.049528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d6e0d-47ac-4962-98a6-b411c75f16e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:10.153436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2a5d6e0d-47ac-4962-98a6-b411c75f16e4 None None] MFA Rules not processed for user `6dc90f9537f6480eb74cba57161b8476`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:10.153436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a5d6e0d-47ac-4962-98a6-b411c75f16e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:10.164415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fc5db-96d4-4944-9be8-e96b72935fef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:10.165096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fc5db-96d4-4944-9be8-e96b72935fef service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:10.167936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fc5db-96d4-4944-9be8-e96b72935fef service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:10.168275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fc5db-96d4-4944-9be8-e96b72935fef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:10.330365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fc5db-96d4-4944-9be8-e96b72935fef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:10.339873 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fc5db-96d4-4944-9be8-e96b72935fef service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:10.373046 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 873/1749] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:10.374077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fc5db-96d4-4944-9be8-e96b72935fef service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:10.416708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 877/1750] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:10.418363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d6e0d-47ac-4962-98a6-b411c75f16e4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:10.602536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fc5db-96d4-4944-9be8-e96b72935fef service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:10.624149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba2013-5c11-46bb-af9d-aebb359eea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:10.624808 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d6e0d-47ac-4962-98a6-b411c75f16e4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:10.625862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba2013-5c11-46bb-af9d-aebb359eea20 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:10.632901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba2013-5c11-46bb-af9d-aebb359eea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:10.633361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba2013-5c11-46bb-af9d-aebb359eea20 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:10.636559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba2013-5c11-46bb-af9d-aebb359eea20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:10.639343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba2013-5c11-46bb-af9d-aebb359eea20 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:10.643368 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd5e71-91b3-4dc3-94a1-170e926d6f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:10.644062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5e71-91b3-4dc3-94a1-170e926d6f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:10.644341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5e71-91b3-4dc3-94a1-170e926d6f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:10.644610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5e71-91b3-4dc3-94a1-170e926d6f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:10.645499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5e71-91b3-4dc3-94a1-170e926d6f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:10.648053 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5e71-91b3-4dc3-94a1-170e926d6f27 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:10.686509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 878/1751] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:10.687844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd5e71-91b3-4dc3-94a1-170e926d6f27 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:10.733387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd5e71-91b3-4dc3-94a1-170e926d6f27 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:10.739326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 874/1752] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:10 2022] POST /identity/v3/users => generated 298 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:10.742031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba2013-5c11-46bb-af9d-aebb359eea20 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:10.750390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-73ba2013-5c11-46bb-af9d-aebb359eea20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:10.758874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd996c65-0fe0-46a2-ba34-1994090e4112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:10.759603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd996c65-0fe0-46a2-ba34-1994090e4112 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:10.760313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd996c65-0fe0-46a2-ba34-1994090e4112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:10.760578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd996c65-0fe0-46a2-ba34-1994090e4112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:10.771582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd996c65-0fe0-46a2-ba34-1994090e4112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:10.773193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd996c65-0fe0-46a2-ba34-1994090e4112 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:10.796990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 879/1753] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:10.798763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd996c65-0fe0-46a2-ba34-1994090e4112 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:10.804878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba2013-5c11-46bb-af9d-aebb359eea20 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:10.828302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd996c65-0fe0-46a2-ba34-1994090e4112 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:10.835901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c1af2-61ca-4f3a-8346-74386dff1842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:10.836656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1af2-61ca-4f3a-8346-74386dff1842 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:10.836871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1af2-61ca-4f3a-8346-74386dff1842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:10.839048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1af2-61ca-4f3a-8346-74386dff1842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:10.839782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c1af2-61ca-4f3a-8346-74386dff1842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:10.840173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dab04-1b56-42e4-bc7e-1ea0c72fac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:10.841068 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dab04-1b56-42e4-bc7e-1ea0c72fac82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:10.841344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dab04-1b56-42e4-bc7e-1ea0c72fac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:10.841616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dab04-1b56-42e4-bc7e-1ea0c72fac82 admin admin] PATH_INFO: `/v3/projects/509d939f811d497985b40861e50f1f60/users/ad319032bd1545259b38d7c6ba18d06c/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:10.848876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dab04-1b56-42e4-bc7e-1ea0c72fac82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509d939f811d497985b40861e50f1f60, user_id=ad319032bd1545259b38d7c6ba18d06c, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:10.850224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c1af2-61ca-4f3a-8346-74386dff1842 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:10.851918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dab04-1b56-42e4-bc7e-1ea0c72fac82 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:10.884990 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 880/1754] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:10 2022] PUT /identity/v3/projects/509d939f811d497985b40861e50f1f60/users/ad319032bd1545259b38d7c6ba18d06c/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:10.886935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dab04-1b56-42e4-bc7e-1ea0c72fac82 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:10.960784 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 875/1755] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:10 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:10.972165 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b794f0a-4abc-4c7e-a331-0d9c25914c3a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:10.974222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b794f0a-4abc-4c7e-a331-0d9c25914c3a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:10.977020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b794f0a-4abc-4c7e-a331-0d9c25914c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:11.063636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dab04-1b56-42e4-bc7e-1ea0c72fac82 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:11.101761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5b794f0a-4abc-4c7e-a331-0d9c25914c3a None None] MFA Rules not processed for user `ad319032bd1545259b38d7c6ba18d06c`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:11.103043 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5b794f0a-4abc-4c7e-a331-0d9c25914c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:11.291663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ad4d8-9cb2-40cc-9e81-b046290c1a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:11.292812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ad4d8-9cb2-40cc-9e81-b046290c1a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:11.293994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ad4d8-9cb2-40cc-9e81-b046290c1a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:11.295129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ad4d8-9cb2-40cc-9e81-b046290c1a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:11.297710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ad4d8-9cb2-40cc-9e81-b046290c1a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:11.300131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 876/1756] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:11.301296 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b794f0a-4abc-4c7e-a331-0d9c25914c3a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:11.302063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ad4d8-9cb2-40cc-9e81-b046290c1a4b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:11.337449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b794f0a-4abc-4c7e-a331-0d9c25914c3a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:11.342980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 881/1757] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:11.344381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ad4d8-9cb2-40cc-9e81-b046290c1a4b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:11.354131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06da9da-cc3e-40b9-a9ab-b3a9a2597405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:11.357021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06da9da-cc3e-40b9-a9ab-b3a9a2597405 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:11.358303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06da9da-cc3e-40b9-a9ab-b3a9a2597405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:11.358713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06da9da-cc3e-40b9-a9ab-b3a9a2597405 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:11.360635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06da9da-cc3e-40b9-a9ab-b3a9a2597405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:11.364032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06da9da-cc3e-40b9-a9ab-b3a9a2597405 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:11.425550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 877/1758] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:11 2022] POST /identity/v3/users => generated 308 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:11.426843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06da9da-cc3e-40b9-a9ab-b3a9a2597405 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:11.455571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06da9da-cc3e-40b9-a9ab-b3a9a2597405 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:11.481264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857960d-a900-4860-8089-005db7266b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:11.482389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857960d-a900-4860-8089-005db7266b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:11.482773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857960d-a900-4860-8089-005db7266b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:11.484177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857960d-a900-4860-8089-005db7266b00 admin admin] PATH_INFO: `/v3/projects/91cdd47870ee4f349d5ac8bfc5b225c5/users/63930513a53d4c65a9428e619a7dae44/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:11.522516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ad4d8-9cb2-40cc-9e81-b046290c1a4b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:11.530204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857960d-a900-4860-8089-005db7266b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cdd47870ee4f349d5ac8bfc5b225c5, user_id=63930513a53d4c65a9428e619a7dae44, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:11.536029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857960d-a900-4860-8089-005db7266b00 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:11.538779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccca47-04b1-48c2-b89d-fdb294220c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:11.539584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccca47-04b1-48c2-b89d-fdb294220c62 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:11.539970 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccca47-04b1-48c2-b89d-fdb294220c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:11.541111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccca47-04b1-48c2-b89d-fdb294220c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:11.571770 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 878/1759] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:11 2022] PUT /identity/v3/projects/91cdd47870ee4f349d5ac8bfc5b225c5/users/63930513a53d4c65a9428e619a7dae44/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:11.575768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccca47-04b1-48c2-b89d-fdb294220c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:11.577842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857960d-a900-4860-8089-005db7266b00 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:11.578902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccca47-04b1-48c2-b89d-fdb294220c62 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:11.621557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 882/1760] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:11.623093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccca47-04b1-48c2-b89d-fdb294220c62 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:11.680733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccca47-04b1-48c2-b89d-fdb294220c62 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:11.885011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857960d-a900-4860-8089-005db7266b00 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:11.899005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b1ca-a020-4018-a7d5-c3affa4c2269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:11.899872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b1ca-a020-4018-a7d5-c3affa4c2269 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:11.900792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b1ca-a020-4018-a7d5-c3affa4c2269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:11.901176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b1ca-a020-4018-a7d5-c3affa4c2269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:11.902101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179b1ca-a020-4018-a7d5-c3affa4c2269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:11.905674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179b1ca-a020-4018-a7d5-c3affa4c2269 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:11.936475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 879/1761] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:11.938150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b1ca-a020-4018-a7d5-c3affa4c2269 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:11.940210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7179b1ca-a020-4018-a7d5-c3affa4c2269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:12.012437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346628e-86a5-4ab3-9131-00232527b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:12.013450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346628e-86a5-4ab3-9131-00232527b7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:12.013855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346628e-86a5-4ab3-9131-00232527b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:12.014066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346628e-86a5-4ab3-9131-00232527b7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:12.016603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346628e-86a5-4ab3-9131-00232527b7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:12.030396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346628e-86a5-4ab3-9131-00232527b7c2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:12.080372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 883/1762] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:12.081238 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346628e-86a5-4ab3-9131-00232527b7c2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:12.102738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b1ca-a020-4018-a7d5-c3affa4c2269 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:12.109045 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b9af7-a667-4d1a-bb5b-2e2f9fecdbf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:12.110451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b9af7-a667-4d1a-bb5b-2e2f9fecdbf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:12.110861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b9af7-a667-4d1a-bb5b-2e2f9fecdbf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:12.111876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b9af7-a667-4d1a-bb5b-2e2f9fecdbf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:12.127022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346628e-86a5-4ab3-9131-00232527b7c2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:12.171016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d2638-a316-40e1-9183-724eb4018804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:12.172075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d2638-a316-40e1-9183-724eb4018804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:12.172406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d2638-a316-40e1-9183-724eb4018804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:12.172628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d2638-a316-40e1-9183-724eb4018804 admin admin] PATH_INFO: `/v3/projects/d76b8a4beb8843fcbe57799a11b35b06/users/259ce7ec0244474e9c392989ca3257a1/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:12.261822 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d2638-a316-40e1-9183-724eb4018804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76b8a4beb8843fcbe57799a11b35b06, user_id=259ce7ec0244474e9c392989ca3257a1, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:12.269427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d2638-a316-40e1-9183-724eb4018804 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:12.273760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b9af7-a667-4d1a-bb5b-2e2f9fecdbf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:12.278236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b9af7-a667-4d1a-bb5b-2e2f9fecdbf4 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:12.334551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 884/1763] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:12 2022] PUT /identity/v3/projects/d76b8a4beb8843fcbe57799a11b35b06/users/259ce7ec0244474e9c392989ca3257a1/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:12.336034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d2638-a316-40e1-9183-724eb4018804 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:12.336267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 880/1764] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:12.343180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b9af7-a667-4d1a-bb5b-2e2f9fecdbf4 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:12.370493 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b9af7-a667-4d1a-bb5b-2e2f9fecdbf4 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:12.576666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d2638-a316-40e1-9183-724eb4018804 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:12.589458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf178e25-5849-48c1-a972-bd67dae9aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:12.590065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf178e25-5849-48c1-a972-bd67dae9aa5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:12.590169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf178e25-5849-48c1-a972-bd67dae9aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:12.590427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf178e25-5849-48c1-a972-bd67dae9aa5a admin admin] PATH_INFO: `/v3/projects/91cdd47870ee4f349d5ac8bfc5b225c5/users/63930513a53d4c65a9428e619a7dae44/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:12.606925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf178e25-5849-48c1-a972-bd67dae9aa5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cdd47870ee4f349d5ac8bfc5b225c5, user_id=63930513a53d4c65a9428e619a7dae44, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:12.623221 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf178e25-5849-48c1-a972-bd67dae9aa5a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:12.643120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a590d-6c88-4c03-ad95-db98e9602c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:12.644672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a590d-6c88-4c03-ad95-db98e9602c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:12.644964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a590d-6c88-4c03-ad95-db98e9602c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:12.645240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a590d-6c88-4c03-ad95-db98e9602c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:12.645983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a590d-6c88-4c03-ad95-db98e9602c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:12.652381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a590d-6c88-4c03-ad95-db98e9602c32 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:12.683984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 885/1765] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:12 2022] PUT /identity/v3/projects/91cdd47870ee4f349d5ac8bfc5b225c5/users/63930513a53d4c65a9428e619a7dae44/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:12.685643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81566bb-6a3c-4711-aa06-9e787d2fab29 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:12.685939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81566bb-6a3c-4711-aa06-9e787d2fab29 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:12.696669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81566bb-6a3c-4711-aa06-9e787d2fab29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:12.733292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 881/1766] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:12.762327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a590d-6c88-4c03-ad95-db98e9602c32 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:12.803848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a81566bb-6a3c-4711-aa06-9e787d2fab29 None None] MFA Rules not processed for user `63930513a53d4c65a9428e619a7dae44`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:12.805745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a81566bb-6a3c-4711-aa06-9e787d2fab29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:12.811706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a590d-6c88-4c03-ad95-db98e9602c32 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:13.035250 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 886/1767] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:13.043204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81566bb-6a3c-4711-aa06-9e787d2fab29 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:13.133553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03596e2e-145b-43bd-8516-564551ebf0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:13.135286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596e2e-145b-43bd-8516-564551ebf0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:13.135286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596e2e-145b-43bd-8516-564551ebf0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:13.135286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596e2e-145b-43bd-8516-564551ebf0d2 admin admin] PATH_INFO: `/v3/projects/d76b8a4beb8843fcbe57799a11b35b06/users/259ce7ec0244474e9c392989ca3257a1/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:13.140501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03596e2e-145b-43bd-8516-564551ebf0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76b8a4beb8843fcbe57799a11b35b06, user_id=259ce7ec0244474e9c392989ca3257a1, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:13.143526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03596e2e-145b-43bd-8516-564551ebf0d2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:13.187512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 882/1768] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:12 2022] PUT /identity/v3/projects/d76b8a4beb8843fcbe57799a11b35b06/users/259ce7ec0244474e9c392989ca3257a1/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:13.199125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81566bb-6a3c-4711-aa06-9e787d2fab29 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:13.360723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdef70-3794-4f3e-b76f-4c218874fe5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:13.361807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdef70-3794-4f3e-b76f-4c218874fe5d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:13.362735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdef70-3794-4f3e-b76f-4c218874fe5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:13.363021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdef70-3794-4f3e-b76f-4c218874fe5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:13.483382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d626e4-1bc7-4ab6-a416-9ab44e9473bf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:13.483811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d626e4-1bc7-4ab6-a416-9ab44e9473bf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:13.484212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d626e4-1bc7-4ab6-a416-9ab44e9473bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:13.520912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdef70-3794-4f3e-b76f-4c218874fe5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:13.527605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdef70-3794-4f3e-b76f-4c218874fe5d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:13.539765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e3d626e4-1bc7-4ab6-a416-9ab44e9473bf None None] MFA Rules not processed for user `b40c7b11fff443fa8c78e8647703e230`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:13.544228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e3d626e4-1bc7-4ab6-a416-9ab44e9473bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:13.569757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 887/1769] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:13.746889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 883/1770] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:13.855889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5580-d29c-4b9a-bb3a-ba3bc2f6498f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:13.862873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5580-d29c-4b9a-bb3a-ba3bc2f6498f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:13.863347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5580-d29c-4b9a-bb3a-ba3bc2f6498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:13.892496 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d626e4-1bc7-4ab6-a416-9ab44e9473bf None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:13.898069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-978f5580-d29c-4b9a-bb3a-ba3bc2f6498f None None] MFA Rules not processed for user `d099a8ecc77b4259aa30f227ae8f28ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:13.900202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-978f5580-d29c-4b9a-bb3a-ba3bc2f6498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:13.910286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d626e4-1bc7-4ab6-a416-9ab44e9473bf None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:13.926365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf01bf3-2393-4802-a546-6a429f7e7c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:13.929225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf01bf3-2393-4802-a546-6a429f7e7c4e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:13.932809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf01bf3-2393-4802-a546-6a429f7e7c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:13.933597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf01bf3-2393-4802-a546-6a429f7e7c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:14.046859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 888/1771] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:42:14.146838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf01bf3-2393-4802-a546-6a429f7e7c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:14.149679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf01bf3-2393-4802-a546-6a429f7e7c4e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:14.177214 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 884/1772] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:42:14.681099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f5580-d29c-4b9a-bb3a-ba3bc2f6498f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:14.786865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f5580-d29c-4b9a-bb3a-ba3bc2f6498f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:14.796188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:14.797320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:14.797817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:14.800232 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] PATH_INFO: `/v3/users/78cd8409ae8843ed993387123167bd4a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:14.802807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=78cd8409ae8843ed993387123167bd4a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:14.805076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:14.885970 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78cd8409ae8843ed993387123167bd4a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:14.904739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78cd8409ae8843ed993387123167bd4a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:14.906946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78cd8409ae8843ed993387123167bd4a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:14.915223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78cd8409ae8843ed993387123167bd4a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:14.926591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78cd8409ae8843ed993387123167bd4a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:14.935729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 889/1773] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:14 2022] DELETE /identity/v3/users/78cd8409ae8843ed993387123167bd4a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:14.940060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c02f6-b647-4f88-bb7b-4b486ebe20de None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:14.940430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c02f6-b647-4f88-bb7b-4b486ebe20de None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:14.940616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c02f6-b647-4f88-bb7b-4b486ebe20de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:14.972235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-407c02f6-b647-4f88-bb7b-4b486ebe20de None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:14.973865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-407c02f6-b647-4f88-bb7b-4b486ebe20de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:15.065864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 885/1774] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:15.075415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:15.083326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:15.171917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e514-e37b-42ac-ae26-e3cbdb6028ea admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:15.176649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead2b3c-19a1-4d42-bd3c-7059eaa28837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:15.176992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead2b3c-19a1-4d42-bd3c-7059eaa28837 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:15.177730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead2b3c-19a1-4d42-bd3c-7059eaa28837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:15.177730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead2b3c-19a1-4d42-bd3c-7059eaa28837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:15.189197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead2b3c-19a1-4d42-bd3c-7059eaa28837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:15.190976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead2b3c-19a1-4d42-bd3c-7059eaa28837 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:15.204642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 890/1775] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:15.517907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c02f6-b647-4f88-bb7b-4b486ebe20de None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:15.519707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-407c02f6-b647-4f88-bb7b-4b486ebe20de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:15.539916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c02f6-b647-4f88-bb7b-4b486ebe20de None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:15.550544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:15.552132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:15.552132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:15.552132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] PATH_INFO: `/v3/projects/5626351bec8943fab1d247bda1e21d35` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:15.553539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5626351bec8943fab1d247bda1e21d35)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:15.555518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:15.703656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5626351bec8943fab1d247bda1e21d35', 'request_id': 'req-62169f28-4966-40c0-969d-96840070d69b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:15.727230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5626351bec8943fab1d247bda1e21d35', 'request_id': 'req-62169f28-4966-40c0-969d-96840070d69b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:15.746822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5626351bec8943fab1d247bda1e21d35', 'request_id': 'req-62169f28-4966-40c0-969d-96840070d69b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:15.767733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] The token cache is being invalidate because project 5626351bec8943fab1d247bda1e21d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:15.768390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:15.769512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62169f28-4966-40c0-969d-96840070d69b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:15.772131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 886/1776] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:15 2022] DELETE /identity/v3/projects/5626351bec8943fab1d247bda1e21d35 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:15.776541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead2b3c-19a1-4d42-bd3c-7059eaa28837 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:15.793943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead2b3c-19a1-4d42-bd3c-7059eaa28837 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:15.908135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:15.911329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:15.911887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:15.912343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] PATH_INFO: `/v3/users/63930513a53d4c65a9428e619a7dae44` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:15.914083 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63930513a53d4c65a9428e619a7dae44)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:15.916964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:16.042548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63930513a53d4c65a9428e619a7dae44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:16.078777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63930513a53d4c65a9428e619a7dae44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:16.082462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63930513a53d4c65a9428e619a7dae44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:16.106694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63930513a53d4c65a9428e619a7dae44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:16.132483 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-89436718-4953-4710-af32-746fbd7e275b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63930513a53d4c65a9428e619a7dae44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:16.148239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 891/1777] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:15 2022] DELETE /identity/v3/users/63930513a53d4c65a9428e619a7dae44 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:16.212148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af959f8-cd9f-48a2-95a0-753880fe8360 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:16.213711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af959f8-cd9f-48a2-95a0-753880fe8360 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:16.214311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af959f8-cd9f-48a2-95a0-753880fe8360 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:16.216010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 887/1778] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:42:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:42:16.232133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8cef1-df11-43f7-9628-6091f28ad5e8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:16.232859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8cef1-df11-43f7-9628-6091f28ad5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:16.233378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8cef1-df11-43f7-9628-6091f28ad5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:16.283958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c6a8cef1-df11-43f7-9628-6091f28ad5e8 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:16.286711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c6a8cef1-df11-43f7-9628-6091f28ad5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:16.433806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 892/1779] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:42:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:16.503298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c44f0-73f2-4e5e-9f00-682e90fe5a46 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:16.503681 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c44f0-73f2-4e5e-9f00-682e90fe5a46 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:16.503889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c44f0-73f2-4e5e-9f00-682e90fe5a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:16.619424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1b7c44f0-73f2-4e5e-9f00-682e90fe5a46 None None] MFA Rules not processed for user `259ce7ec0244474e9c392989ca3257a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:16.623516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1b7c44f0-73f2-4e5e-9f00-682e90fe5a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:16.819260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 888/1780] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:17.036445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8cef1-df11-43f7-9628-6091f28ad5e8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:17.038039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c6a8cef1-df11-43f7-9628-6091f28ad5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:17.069404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8cef1-df11-43f7-9628-6091f28ad5e8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:17.077852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00a6e3-74ae-435d-9613-6c9ab2d6b3df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:17.078828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00a6e3-74ae-435d-9613-6c9ab2d6b3df service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.079327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00a6e3-74ae-435d-9613-6c9ab2d6b3df service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.080294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00a6e3-74ae-435d-9613-6c9ab2d6b3df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.092848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00a6e3-74ae-435d-9613-6c9ab2d6b3df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:17.097858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00a6e3-74ae-435d-9613-6c9ab2d6b3df service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:17.113974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 893/1781] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:17.250274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c44f0-73f2-4e5e-9f00-682e90fe5a46 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:17.252846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1b7c44f0-73f2-4e5e-9f00-682e90fe5a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:17.357145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c44f0-73f2-4e5e-9f00-682e90fe5a46 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:17.365825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:17.365825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.365825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.366289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] PATH_INFO: `/v3/projects/91cdd47870ee4f349d5ac8bfc5b225c5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.367587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cdd47870ee4f349d5ac8bfc5b225c5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:17.370169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:17.434292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cdd47870ee4f349d5ac8bfc5b225c5', 'request_id': 'req-bdc18e11-4b19-486e-8440-dcb77b2e8545'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:17.441790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cdd47870ee4f349d5ac8bfc5b225c5', 'request_id': 'req-bdc18e11-4b19-486e-8440-dcb77b2e8545'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:17.454343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cdd47870ee4f349d5ac8bfc5b225c5', 'request_id': 'req-bdc18e11-4b19-486e-8440-dcb77b2e8545'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:17.470107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] The token cache is being invalidate because project 91cdd47870ee4f349d5ac8bfc5b225c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:17.470715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:17.471709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bdc18e11-4b19-486e-8440-dcb77b2e8545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:17.473465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 889/1782] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:17 2022] DELETE /identity/v3/projects/91cdd47870ee4f349d5ac8bfc5b225c5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:17.479266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0578d7-ee4c-473e-beef-620be074a93d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.480367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0578d7-ee4c-473e-beef-620be074a93d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.480686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0578d7-ee4c-473e-beef-620be074a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.506297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dd0578d7-ee4c-473e-beef-620be074a93d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:17.507743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dd0578d7-ee4c-473e-beef-620be074a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:17.587069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 894/1783] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:17.595306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5c069-5012-4e44-8ea8-a91e2be5a84f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.595306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5c069-5012-4e44-8ea8-a91e2be5a84f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.595505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5c069-5012-4e44-8ea8-a91e2be5a84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.617260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-abb5c069-5012-4e44-8ea8-a91e2be5a84f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:17.618724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-abb5c069-5012-4e44-8ea8-a91e2be5a84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:17.627132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 890/1784] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:17.631293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0578d7-ee4c-473e-beef-620be074a93d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:17.640843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0578d7-ee4c-473e-beef-620be074a93d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:17.645551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e70e8-d870-4773-960d-f2ce52fdb062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:17.646241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e70e8-d870-4773-960d-f2ce52fdb062 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.646513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e70e8-d870-4773-960d-f2ce52fdb062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.646786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e70e8-d870-4773-960d-f2ce52fdb062 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.647552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e70e8-d870-4773-960d-f2ce52fdb062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:42:17.647871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e70e8-d870-4773-960d-f2ce52fdb062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:17.649462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e70e8-d870-4773-960d-f2ce52fdb062 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:17.661151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 895/1785] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:42:17.665385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5c069-5012-4e44-8ea8-a91e2be5a84f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:17.675701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5c069-5012-4e44-8ea8-a91e2be5a84f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:17.680383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e45de9-a23a-4eee-80c3-104d6394f626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:17.681053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e45de9-a23a-4eee-80c3-104d6394f626 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.681390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e45de9-a23a-4eee-80c3-104d6394f626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.681665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e45de9-a23a-4eee-80c3-104d6394f626 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.682423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e45de9-a23a-4eee-80c3-104d6394f626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:17.684335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e45de9-a23a-4eee-80c3-104d6394f626 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:17.718657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 891/1786] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:17 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:17.720321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e70e8-d870-4773-960d-f2ce52fdb062 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:17.736217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e70e8-d870-4773-960d-f2ce52fdb062 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:17.798150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901c57c-713f-4374-b4bd-9b89e25db118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:17.798964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901c57c-713f-4374-b4bd-9b89e25db118 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.799254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901c57c-713f-4374-b4bd-9b89e25db118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.799534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901c57c-713f-4374-b4bd-9b89e25db118 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.800256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901c57c-713f-4374-b4bd-9b89e25db118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:17.802284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901c57c-713f-4374-b4bd-9b89e25db118 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:17.822912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 896/1787] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:17 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:17.826913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e45de9-a23a-4eee-80c3-104d6394f626 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:17.837270 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e45de9-a23a-4eee-80c3-104d6394f626 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:17.845127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754809-dc34-457b-88e7-0a5aa7678a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:17.845897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754809-dc34-457b-88e7-0a5aa7678a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.846223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754809-dc34-457b-88e7-0a5aa7678a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.846502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754809-dc34-457b-88e7-0a5aa7678a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.847233 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754809-dc34-457b-88e7-0a5aa7678a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:17.848863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754809-dc34-457b-88e7-0a5aa7678a09 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:17.862425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 892/1788] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:17.871381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901c57c-713f-4374-b4bd-9b89e25db118 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:17.885274 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901c57c-713f-4374-b4bd-9b89e25db118 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:17.891124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e87ef-7748-4391-9b1d-2edaf0fce519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:17.891826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e87ef-7748-4391-9b1d-2edaf0fce519 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.892105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e87ef-7748-4391-9b1d-2edaf0fce519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.892379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e87ef-7748-4391-9b1d-2edaf0fce519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.893212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e87ef-7748-4391-9b1d-2edaf0fce519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:17.894900 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e87ef-7748-4391-9b1d-2edaf0fce519 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:17.906965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 897/1789] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:17.910696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754809-dc34-457b-88e7-0a5aa7678a09 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:17.923187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754809-dc34-457b-88e7-0a5aa7678a09 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:17.928352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd7883-fa58-4b62-8456-8e85937ffff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:17.929467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd7883-fa58-4b62-8456-8e85937ffff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.929752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd7883-fa58-4b62-8456-8e85937ffff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.930057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd7883-fa58-4b62-8456-8e85937ffff0 admin admin] PATH_INFO: `/v3/projects/ca2444fc9d724881b212f4a9d24ca430/users/d2ca95f4eee44b81b58343a150357432/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:17.956689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd7883-fa58-4b62-8456-8e85937ffff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2444fc9d724881b212f4a9d24ca430, user_id=d2ca95f4eee44b81b58343a150357432, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:17.959569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd7883-fa58-4b62-8456-8e85937ffff0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:17.992257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 893/1790] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:17 2022] PUT /identity/v3/projects/ca2444fc9d724881b212f4a9d24ca430/users/d2ca95f4eee44b81b58343a150357432/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:17.997439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a422af0-90fd-48f2-a83b-2234abab6316 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:17.997801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a422af0-90fd-48f2-a83b-2234abab6316 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:17.999907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a422af0-90fd-48f2-a83b-2234abab6316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:18.024756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0a422af0-90fd-48f2-a83b-2234abab6316 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:18.028060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0a422af0-90fd-48f2-a83b-2234abab6316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:18.102292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 898/1791] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:18.113026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd7883-fa58-4b62-8456-8e85937ffff0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:18.114995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2edd7883-fa58-4b62-8456-8e85937ffff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:18.192741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd7883-fa58-4b62-8456-8e85937ffff0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:18.198528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88dd62-5909-45e1-b3a7-c6ef038f368a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:18.199239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88dd62-5909-45e1-b3a7-c6ef038f368a service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:18.199723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88dd62-5909-45e1-b3a7-c6ef038f368a service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:18.199915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88dd62-5909-45e1-b3a7-c6ef038f368a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:18.214098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88dd62-5909-45e1-b3a7-c6ef038f368a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:18.215815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88dd62-5909-45e1-b3a7-c6ef038f368a service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:18.238411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 894/1792] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:18.883244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a422af0-90fd-48f2-a83b-2234abab6316 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:18.885753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0a422af0-90fd-48f2-a83b-2234abab6316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:18.914910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a422af0-90fd-48f2-a83b-2234abab6316 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:18.921512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:18.922984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:18.923451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:18.924268 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] PATH_INFO: `/v3/users/6dc90f9537f6480eb74cba57161b8476` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:18.926625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc90f9537f6480eb74cba57161b8476)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:18.931008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:18.997878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc90f9537f6480eb74cba57161b8476'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.011574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc90f9537f6480eb74cba57161b8476'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.012673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc90f9537f6480eb74cba57161b8476'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.021103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc90f9537f6480eb74cba57161b8476'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.030759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc90f9537f6480eb74cba57161b8476'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.040999 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 899/1793] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:18 2022] DELETE /identity/v3/users/6dc90f9537f6480eb74cba57161b8476 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:19.246077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b00a72-07a4-418f-9bcf-629863f3185c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.246962 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b00a72-07a4-418f-9bcf-629863f3185c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.247379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b00a72-07a4-418f-9bcf-629863f3185c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.311700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f0b00a72-07a4-418f-9bcf-629863f3185c None None] MFA Rules not processed for user `d2ca95f4eee44b81b58343a150357432`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:19.327363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0b00a72-07a4-418f-9bcf-629863f3185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:19.349851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:19.349851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:19.476785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 895/1794] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:19.481747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b00a72-07a4-418f-9bcf-629863f3185c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:19.483115 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0b00a72-07a4-418f-9bcf-629863f3185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:19.491242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7716a-0f5d-4d80-b1b4-d818a84a58b4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:19.496673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b00a72-07a4-418f-9bcf-629863f3185c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:19.496943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:19.497795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.498104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.498376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] PATH_INFO: `/v3/projects/57d6debc5607465899ca7468dc207367` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.499544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d6debc5607465899ca7468dc207367)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:19.501432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:19.501604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a0de8-c72b-44bd-b951-55d6e60ca82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:19.502289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a0de8-c72b-44bd-b951-55d6e60ca82d admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.502576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a0de8-c72b-44bd-b951-55d6e60ca82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.502870 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a0de8-c72b-44bd-b951-55d6e60ca82d admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.503534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a0de8-c72b-44bd-b951-55d6e60ca82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:19.505423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a0de8-c72b-44bd-b951-55d6e60ca82d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:19.534147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 896/1795] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:19 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:42:19.535638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a0de8-c72b-44bd-b951-55d6e60ca82d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:19.549073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d6debc5607465899ca7468dc207367', 'request_id': 'req-cb7dea37-ac30-4dbf-888f-4d0a671cc877'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.556239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d6debc5607465899ca7468dc207367', 'request_id': 'req-cb7dea37-ac30-4dbf-888f-4d0a671cc877'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.563623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d6debc5607465899ca7468dc207367', 'request_id': 'req-cb7dea37-ac30-4dbf-888f-4d0a671cc877'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.574333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] The token cache is being invalidate because project 57d6debc5607465899ca7468dc207367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:19.574615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.575237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.576761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 900/1796] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:19 2022] DELETE /identity/v3/projects/57d6debc5607465899ca7468dc207367 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:19.580531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:19.581816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:19.595832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a0de8-c72b-44bd-b951-55d6e60ca82d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:19.645258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dea37-ac30-4dbf-888f-4d0a671cc877 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:19.649605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2aa449-2e87-4c7d-8cda-f59676d3f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:19.650501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:19.650846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aa449-2e87-4c7d-8cda-f59676d3f391 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.651125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aa449-2e87-4c7d-8cda-f59676d3f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.651393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aa449-2e87-4c7d-8cda-f59676d3f391 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.651565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.651855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.652070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2aa449-2e87-4c7d-8cda-f59676d3f391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:19.652165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] PATH_INFO: `/v3/users/259ce7ec0244474e9c392989ca3257a1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.653313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259ce7ec0244474e9c392989ca3257a1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:19.653989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2aa449-2e87-4c7d-8cda-f59676d3f391 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:19.655255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:19.677051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 897/1797] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:19 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:42:19.680759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2aa449-2e87-4c7d-8cda-f59676d3f391 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:19.684707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3d2aa449-2e87-4c7d-8cda-f59676d3f391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:19.697741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2aa449-2e87-4c7d-8cda-f59676d3f391 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:19.702997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f5c93-b000-4cf9-9998-c37ee5c90e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:19.703669 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f5c93-b000-4cf9-9998-c37ee5c90e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.703952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f5c93-b000-4cf9-9998-c37ee5c90e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.704228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f5c93-b000-4cf9-9998-c37ee5c90e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.704957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f5c93-b000-4cf9-9998-c37ee5c90e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:19.706589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f5c93-b000-4cf9-9998-c37ee5c90e78 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:19.709335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259ce7ec0244474e9c392989ca3257a1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.717012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 898/1798] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:19.720884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f5c93-b000-4cf9-9998-c37ee5c90e78 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:19.721383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259ce7ec0244474e9c392989ca3257a1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.722144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259ce7ec0244474e9c392989ca3257a1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.729452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259ce7ec0244474e9c392989ca3257a1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.732164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f5c93-b000-4cf9-9998-c37ee5c90e78 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:19.736812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259ce7ec0244474e9c392989ca3257a1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:19.737130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de58900-728f-4c89-9bf5-2bc316ad6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:19.737956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58900-728f-4c89-9bf5-2bc316ad6f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.738268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58900-728f-4c89-9bf5-2bc316ad6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.738603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58900-728f-4c89-9bf5-2bc316ad6f2e admin admin] PATH_INFO: `/v3/projects/ce75b97c54f34e4a9db8b69776d135c2/users/f4638689583f4b059f584893eb1ccd84/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.742819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 901/1799] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:19 2022] DELETE /identity/v3/users/259ce7ec0244474e9c392989ca3257a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:19.753579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de58900-728f-4c89-9bf5-2bc316ad6f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce75b97c54f34e4a9db8b69776d135c2, user_id=f4638689583f4b059f584893eb1ccd84, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:19.756259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de58900-728f-4c89-9bf5-2bc316ad6f2e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:19.770282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 899/1800] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:19 2022] PUT /identity/v3/projects/ce75b97c54f34e4a9db8b69776d135c2/users/f4638689583f4b059f584893eb1ccd84/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:19.774145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:19.775673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:19.839952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f584b-9e3f-4e5c-b00f-f9322619b5b7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:19.896257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c5c2-55e0-4b9c-8690-448c8cf12a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:19.897067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c5c2-55e0-4b9c-8690-448c8cf12a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.897430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c5c2-55e0-4b9c-8690-448c8cf12a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.897806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c5c2-55e0-4b9c-8690-448c8cf12a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.898629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c5c2-55e0-4b9c-8690-448c8cf12a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:19.900851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c5c2-55e0-4b9c-8690-448c8cf12a28 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:19.912045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 902/1801] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:19.917531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de58900-728f-4c89-9bf5-2bc316ad6f2e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:19.919658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c5c2-55e0-4b9c-8690-448c8cf12a28 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:19.921468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b6e9c5c2-55e0-4b9c-8690-448c8cf12a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:19.928325 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de58900-728f-4c89-9bf5-2bc316ad6f2e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:19.934444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c5c2-55e0-4b9c-8690-448c8cf12a28 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:19.939337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f091d85-b970-462b-879f-ea8fa0821481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:19.940239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f091d85-b970-462b-879f-ea8fa0821481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.940519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f091d85-b970-462b-879f-ea8fa0821481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.940791 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f091d85-b970-462b-879f-ea8fa0821481 admin admin] PATH_INFO: `/v3/projects/ce75b97c54f34e4a9db8b69776d135c2/users/f4638689583f4b059f584893eb1ccd84/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.943364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:19.944548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:19.944909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:19.945305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] PATH_INFO: `/v3/projects/d76b8a4beb8843fcbe57799a11b35b06` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:19.946870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76b8a4beb8843fcbe57799a11b35b06)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:19.948051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f091d85-b970-462b-879f-ea8fa0821481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce75b97c54f34e4a9db8b69776d135c2, user_id=f4638689583f4b059f584893eb1ccd84, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:19.949093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:19.952027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f091d85-b970-462b-879f-ea8fa0821481 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:19.966915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 900/1802] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:19 2022] PUT /identity/v3/projects/ce75b97c54f34e4a9db8b69776d135c2/users/f4638689583f4b059f584893eb1ccd84/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:19.998779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76b8a4beb8843fcbe57799a11b35b06', 'request_id': 'req-4bea226a-1351-482b-835d-c0681e5077cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:20.005411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76b8a4beb8843fcbe57799a11b35b06', 'request_id': 'req-4bea226a-1351-482b-835d-c0681e5077cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:20.013069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76b8a4beb8843fcbe57799a11b35b06', 'request_id': 'req-4bea226a-1351-482b-835d-c0681e5077cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:20.027841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] The token cache is being invalidate because project d76b8a4beb8843fcbe57799a11b35b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:20.028269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:20.029033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bea226a-1351-482b-835d-c0681e5077cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:20.031126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 903/1803] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:19 2022] DELETE /identity/v3/projects/d76b8a4beb8843fcbe57799a11b35b06 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:20.035787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541293c1-b908-4621-8f0b-b40724824dca None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.036359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541293c1-b908-4621-8f0b-b40724824dca None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.036670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541293c1-b908-4621-8f0b-b40724824dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.059649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-541293c1-b908-4621-8f0b-b40724824dca None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:20.060919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-541293c1-b908-4621-8f0b-b40724824dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:20.204834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 901/1804] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:42:20.214201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6bd1d-ff56-42f0-9d73-d3c57bce0b64 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.214814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6bd1d-ff56-42f0-9d73-d3c57bce0b64 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.218387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6bd1d-ff56-42f0-9d73-d3c57bce0b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.238226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-67f6bd1d-ff56-42f0-9d73-d3c57bce0b64 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:20.239422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-67f6bd1d-ff56-42f0-9d73-d3c57bce0b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:20.247991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 904/1805] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:20.252493 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541293c1-b908-4621-8f0b-b40724824dca None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:20.264411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541293c1-b908-4621-8f0b-b40724824dca None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:20.269419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d4f9-c706-4d18-85bd-c1e550210f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:20.270052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d4f9-c706-4d18-85bd-c1e550210f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.270291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d4f9-c706-4d18-85bd-c1e550210f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.270569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d4f9-c706-4d18-85bd-c1e550210f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.271300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74d4f9-c706-4d18-85bd-c1e550210f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:42:20.271606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74d4f9-c706-4d18-85bd-c1e550210f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:20.273205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74d4f9-c706-4d18-85bd-c1e550210f37 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:20.294342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 902/1806] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:42:20.295476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6bd1d-ff56-42f0-9d73-d3c57bce0b64 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:20.304981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6bd1d-ff56-42f0-9d73-d3c57bce0b64 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:20.310170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb185f7-e05f-4b6e-9914-b7f38e9642a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:20.310846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb185f7-e05f-4b6e-9914-b7f38e9642a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.311204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb185f7-e05f-4b6e-9914-b7f38e9642a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.311548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb185f7-e05f-4b6e-9914-b7f38e9642a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.312331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb185f7-e05f-4b6e-9914-b7f38e9642a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:20.314324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb185f7-e05f-4b6e-9914-b7f38e9642a9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:20.348154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 905/1807] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:20 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:42:20.352615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d4f9-c706-4d18-85bd-c1e550210f37 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:20.365508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d4f9-c706-4d18-85bd-c1e550210f37 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:20.448168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e294c-a3cf-4132-b45f-10f6c35ac6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:20.449525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e294c-a3cf-4132-b45f-10f6c35ac6cd admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.450062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e294c-a3cf-4132-b45f-10f6c35ac6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.450558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e294c-a3cf-4132-b45f-10f6c35ac6cd admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.451438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e294c-a3cf-4132-b45f-10f6c35ac6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:20.453888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e294c-a3cf-4132-b45f-10f6c35ac6cd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:20.489799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb185f7-e05f-4b6e-9914-b7f38e9642a9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:20.490327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 903/1808] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:20 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:20.505940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb185f7-e05f-4b6e-9914-b7f38e9642a9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:20.512543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853b50-2a93-4278-822e-fde6c96f637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:20.513271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853b50-2a93-4278-822e-fde6c96f637b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.513645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853b50-2a93-4278-822e-fde6c96f637b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.513919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853b50-2a93-4278-822e-fde6c96f637b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.514722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853b50-2a93-4278-822e-fde6c96f637b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:20.516313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853b50-2a93-4278-822e-fde6c96f637b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:20.528788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 906/1809] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:42:20.533102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e294c-a3cf-4132-b45f-10f6c35ac6cd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:20.549189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e294c-a3cf-4132-b45f-10f6c35ac6cd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:20.557273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2359-e93a-446e-b470-5018ec17f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:20.557963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2359-e93a-446e-b470-5018ec17f86a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.558313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2359-e93a-446e-b470-5018ec17f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.558588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2359-e93a-446e-b470-5018ec17f86a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.559371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2359-e93a-446e-b470-5018ec17f86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:20.561257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2359-e93a-446e-b470-5018ec17f86a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:20.573868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 904/1810] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:42:20.577661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853b50-2a93-4278-822e-fde6c96f637b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:20.590896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853b50-2a93-4278-822e-fde6c96f637b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:20.614254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483d330-8eba-4467-ac83-6bfecfc16e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:20.617516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483d330-8eba-4467-ac83-6bfecfc16e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.617989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483d330-8eba-4467-ac83-6bfecfc16e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.618446 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483d330-8eba-4467-ac83-6bfecfc16e21 admin admin] PATH_INFO: `/v3/projects/1be0c3b5d4c44283afcbac4a419526cd/users/4f5da93be5a54edcaa51d41dacc433e7/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.653236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483d330-8eba-4467-ac83-6bfecfc16e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be0c3b5d4c44283afcbac4a419526cd, user_id=4f5da93be5a54edcaa51d41dacc433e7, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:20.656349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483d330-8eba-4467-ac83-6bfecfc16e21 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:20.691267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 907/1811] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:20 2022] PUT /identity/v3/projects/1be0c3b5d4c44283afcbac4a419526cd/users/4f5da93be5a54edcaa51d41dacc433e7/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:20.704060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0dc8-048d-4a7b-a0fe-05e0470fcd3e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.704544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0dc8-048d-4a7b-a0fe-05e0470fcd3e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.704895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0dc8-048d-4a7b-a0fe-05e0470fcd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.743335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-190d0dc8-048d-4a7b-a0fe-05e0470fcd3e None None] MFA Rules not processed for user `4f5da93be5a54edcaa51d41dacc433e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:20.745213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-190d0dc8-048d-4a7b-a0fe-05e0470fcd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:20.847165 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 905/1812] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:20.847762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483d330-8eba-4467-ac83-6bfecfc16e21 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:20.927584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483d330-8eba-4467-ac83-6bfecfc16e21 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:20.934236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786f7f5-7be3-4874-910d-df5cca25e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:20.934236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786f7f5-7be3-4874-910d-df5cca25e0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.934515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786f7f5-7be3-4874-910d-df5cca25e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.934792 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786f7f5-7be3-4874-910d-df5cca25e0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.935504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786f7f5-7be3-4874-910d-df5cca25e0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:20.937453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786f7f5-7be3-4874-910d-df5cca25e0eb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:20.944496 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6fb7-3c7c-42af-8cd4-f0e6ec0b82de None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:20.944787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6fb7-3c7c-42af-8cd4-f0e6ec0b82de None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:20.945074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6fb7-3c7c-42af-8cd4-f0e6ec0b82de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:20.983168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-14fa6fb7-3c7c-42af-8cd4-f0e6ec0b82de None None] MFA Rules not processed for user `f4638689583f4b059f584893eb1ccd84`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:20.983870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 908/1813] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:20 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:42:20.987624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-14fa6fb7-3c7c-42af-8cd4-f0e6ec0b82de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:20.987765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786f7f5-7be3-4874-910d-df5cca25e0eb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:21.063704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786f7f5-7be3-4874-910d-df5cca25e0eb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:21.070031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ba08-d02b-4e63-b55c-95664c658aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:21.070701 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ba08-d02b-4e63-b55c-95664c658aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:21.070980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ba08-d02b-4e63-b55c-95664c658aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:21.071257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ba08-d02b-4e63-b55c-95664c658aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:21.071974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ba08-d02b-4e63-b55c-95664c658aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:21.073882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ba08-d02b-4e63-b55c-95664c658aa2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:21.087394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 906/1814] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:21.098592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6fb7-3c7c-42af-8cd4-f0e6ec0b82de None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:21.100546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-14fa6fb7-3c7c-42af-8cd4-f0e6ec0b82de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:21.110421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 909/1815] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:20 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:21.111360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ba08-d02b-4e63-b55c-95664c658aa2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:21.122566 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ba08-d02b-4e63-b55c-95664c658aa2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:21.128675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7735af-dec4-4136-b817-1d335a2db2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:21.144524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7735af-dec4-4136-b817-1d335a2db2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:21.144987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7735af-dec4-4136-b817-1d335a2db2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:21.145395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7735af-dec4-4136-b817-1d335a2db2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:21.146180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7735af-dec4-4136-b817-1d335a2db2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:21.148056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7735af-dec4-4136-b817-1d335a2db2c4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:21.187525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 910/1816] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:21.188621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7735af-dec4-4136-b817-1d335a2db2c4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:21.208456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6fb7-3c7c-42af-8cd4-f0e6ec0b82de None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:21.208727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7735af-dec4-4136-b817-1d335a2db2c4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:21.213426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0c0ae-edf8-4f8d-bfda-1f64a7f576ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:21.214104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0c0ae-edf8-4f8d-bfda-1f64a7f576ee service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:21.214388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0c0ae-edf8-4f8d-bfda-1f64a7f576ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:21.214682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0c0ae-edf8-4f8d-bfda-1f64a7f576ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:21.215872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c237b3-127a-4b6e-9f03-a16c9f93a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:21.216470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fcd0c0ae-edf8-4f8d-bfda-1f64a7f576ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:21.216841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c237b3-127a-4b6e-9f03-a16c9f93a504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:21.217064 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c237b3-127a-4b6e-9f03-a16c9f93a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:21.217341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c237b3-127a-4b6e-9f03-a16c9f93a504 admin admin] PATH_INFO: `/v3/projects/4f3d1c45c7894691ac6b58cf75e077ce/users/ae3283c04da64a5d853c66b4f0f66d8d/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:21.240812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c237b3-127a-4b6e-9f03-a16c9f93a504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3d1c45c7894691ac6b58cf75e077ce, user_id=ae3283c04da64a5d853c66b4f0f66d8d, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:21.244556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c237b3-127a-4b6e-9f03-a16c9f93a504 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:21.262947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 911/1817] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:21 2022] PUT /identity/v3/projects/4f3d1c45c7894691ac6b58cf75e077ce/users/ae3283c04da64a5d853c66b4f0f66d8d/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:21.267568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c237b3-127a-4b6e-9f03-a16c9f93a504 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:21.295868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0c0ae-edf8-4f8d-bfda-1f64a7f576ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:21.297309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0c0ae-edf8-4f8d-bfda-1f64a7f576ee service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:21.306502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 907/1818] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:42:21.357853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c237b3-127a-4b6e-9f03-a16c9f93a504 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:21.364117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00f7b0-8b4d-452f-8a50-e2a098374c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:21.364944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00f7b0-8b4d-452f-8a50-e2a098374c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:21.365269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00f7b0-8b4d-452f-8a50-e2a098374c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:21.365737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00f7b0-8b4d-452f-8a50-e2a098374c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:21.366468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00f7b0-8b4d-452f-8a50-e2a098374c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:21.368197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00f7b0-8b4d-452f-8a50-e2a098374c7d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:21.382044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 912/1819] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:21.383666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0c0ae-edf8-4f8d-bfda-1f64a7f576ee service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:21.400250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0c0ae-edf8-4f8d-bfda-1f64a7f576ee service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:21.406370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856925aa-caa0-4123-a753-18a92dee80dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:21.407269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856925aa-caa0-4123-a753-18a92dee80dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:21.407548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856925aa-caa0-4123-a753-18a92dee80dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:21.407826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856925aa-caa0-4123-a753-18a92dee80dd admin admin] PATH_INFO: `/v3/projects/4f3d1c45c7894691ac6b58cf75e077ce/users/ae3283c04da64a5d853c66b4f0f66d8d/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:21.409798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856925aa-caa0-4123-a753-18a92dee80dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3d1c45c7894691ac6b58cf75e077ce, user_id=ae3283c04da64a5d853c66b4f0f66d8d, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:21.412511 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856925aa-caa0-4123-a753-18a92dee80dd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:21.426951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 908/1820] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:21 2022] PUT /identity/v3/projects/4f3d1c45c7894691ac6b58cf75e077ce/users/ae3283c04da64a5d853c66b4f0f66d8d/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:21.439958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab7e56-2c1b-497e-a9c6-7b43ae86ed6d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:21.440512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab7e56-2c1b-497e-a9c6-7b43ae86ed6d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:21.441124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab7e56-2c1b-497e-a9c6-7b43ae86ed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:21.486857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-95ab7e56-2c1b-497e-a9c6-7b43ae86ed6d None None] MFA Rules not processed for user `ae3283c04da64a5d853c66b4f0f66d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:21.488234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-95ab7e56-2c1b-497e-a9c6-7b43ae86ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:21.570785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856925aa-caa0-4123-a753-18a92dee80dd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:21.573347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-856925aa-caa0-4123-a753-18a92dee80dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:21.632194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 913/1821] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:21.661051 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab7e56-2c1b-497e-a9c6-7b43ae86ed6d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:21.721423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856925aa-caa0-4123-a753-18a92dee80dd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:21.736695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e6b72-ff54-4f85-bccc-054c4eb34ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:21.737864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e6b72-ff54-4f85-bccc-054c4eb34ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:21.739798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e6b72-ff54-4f85-bccc-054c4eb34ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:21.740265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e6b72-ff54-4f85-bccc-054c4eb34ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:21.747516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8b6e6b72-ff54-4f85-bccc-054c4eb34ec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:21.817735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab7e56-2c1b-497e-a9c6-7b43ae86ed6d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:21.835910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076286d-2115-41bc-842f-d94559733005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:21.836591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076286d-2115-41bc-842f-d94559733005 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:21.836893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076286d-2115-41bc-842f-d94559733005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:21.837156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076286d-2115-41bc-842f-d94559733005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:21.872118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e6b72-ff54-4f85-bccc-054c4eb34ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:21.876641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076286d-2115-41bc-842f-d94559733005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:21.877247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e6b72-ff54-4f85-bccc-054c4eb34ec6 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:21.878463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076286d-2115-41bc-842f-d94559733005 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:21.905696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 914/1822] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:21.906488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 909/1823] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:22.073331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076286d-2115-41bc-842f-d94559733005 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:22.081826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076286d-2115-41bc-842f-d94559733005 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:22.085308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38fc0d-260b-43d8-9578-5a50ae2dd14d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:22.085934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38fc0d-260b-43d8-9578-5a50ae2dd14d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:22.086246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38fc0d-260b-43d8-9578-5a50ae2dd14d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:22.086555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38fc0d-260b-43d8-9578-5a50ae2dd14d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:22.150733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38fc0d-260b-43d8-9578-5a50ae2dd14d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:22.152362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38fc0d-260b-43d8-9578-5a50ae2dd14d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:22.163299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 915/1824] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:22.736928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e6b72-ff54-4f85-bccc-054c4eb34ec6 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:22.745917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e6b72-ff54-4f85-bccc-054c4eb34ec6 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:22.749727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3079c-fb29-4764-bb36-9eb55964130e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:22.750540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3079c-fb29-4764-bb36-9eb55964130e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:22.750884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3079c-fb29-4764-bb36-9eb55964130e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:22.751237 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3079c-fb29-4764-bb36-9eb55964130e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:22.839360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3079c-fb29-4764-bb36-9eb55964130e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:22.840946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3079c-fb29-4764-bb36-9eb55964130e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:22.866100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 910/1825] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:30.188298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38fc0d-260b-43d8-9578-5a50ae2dd14d service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:30.190972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cd38fc0d-260b-43d8-9578-5a50ae2dd14d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:30.290511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38fc0d-260b-43d8-9578-5a50ae2dd14d service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:30.296580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:30.297926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:30.298277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:30.298559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] PATH_INFO: `/v3/users/423e110304844507ba47e60710e628f0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:30.300759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423e110304844507ba47e60710e628f0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:30.302879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:30.391464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423e110304844507ba47e60710e628f0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:30.408175 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423e110304844507ba47e60710e628f0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:30.409278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423e110304844507ba47e60710e628f0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:30.423167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423e110304844507ba47e60710e628f0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:30.434782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423e110304844507ba47e60710e628f0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:30.449750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 916/1826] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:30 2022] DELETE /identity/v3/users/423e110304844507ba47e60710e628f0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:30.454731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f497f3-f7fa-4c38-b452-8b59e8131702 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:30.455576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f497f3-f7fa-4c38-b452-8b59e8131702 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:30.455855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f497f3-f7fa-4c38-b452-8b59e8131702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:30.494824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f8f497f3-f7fa-4c38-b452-8b59e8131702 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:30.496072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f8f497f3-f7fa-4c38-b452-8b59e8131702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:30.579445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 911/1827] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:30.601352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:30.604091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:30.681033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cfbde-f384-43da-b84d-2e1c44c8efe5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:30.686023 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d4b9-3d57-4290-b028-8032947f1715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:30.686797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d4b9-3d57-4290-b028-8032947f1715 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:30.687305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d4b9-3d57-4290-b028-8032947f1715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:30.687652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d4b9-3d57-4290-b028-8032947f1715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:30.699461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771d4b9-3d57-4290-b028-8032947f1715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:30.701397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771d4b9-3d57-4290-b028-8032947f1715 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:30.713241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 917/1828] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:42:31.390440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f497f3-f7fa-4c38-b452-8b59e8131702 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:31.397374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f8f497f3-f7fa-4c38-b452-8b59e8131702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:31.423116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f497f3-f7fa-4c38-b452-8b59e8131702 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:31.432011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:31.432911 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:31.433252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:31.433533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] PATH_INFO: `/v3/projects/98fcc4cbda644a37a0a6870d2b235777` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:31.437588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98fcc4cbda644a37a0a6870d2b235777)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:31.439625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:31.548562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98fcc4cbda644a37a0a6870d2b235777', 'request_id': 'req-5e93eda3-cb7d-497f-ba85-5e6f8f796209'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.572943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98fcc4cbda644a37a0a6870d2b235777', 'request_id': 'req-5e93eda3-cb7d-497f-ba85-5e6f8f796209'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.594693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98fcc4cbda644a37a0a6870d2b235777', 'request_id': 'req-5e93eda3-cb7d-497f-ba85-5e6f8f796209'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.609482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] The token cache is being invalidate because project 98fcc4cbda644a37a0a6870d2b235777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:31.609760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.610517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.612587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 912/1829] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:31 2022] DELETE /identity/v3/projects/98fcc4cbda644a37a0a6870d2b235777 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:31.617056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d4b9-3d57-4290-b028-8032947f1715 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:31.640694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d4b9-3d57-4290-b028-8032947f1715 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:31.732191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:31.733099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:31.733375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:31.734342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] PATH_INFO: `/v3/users/ad319032bd1545259b38d7c6ba18d06c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:31.735630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad319032bd1545259b38d7c6ba18d06c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:31.737575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:31.787340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad319032bd1545259b38d7c6ba18d06c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.802090 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad319032bd1545259b38d7c6ba18d06c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.803081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad319032bd1545259b38d7c6ba18d06c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.811158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad319032bd1545259b38d7c6ba18d06c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.819101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bf604184-71b2-4713-9842-85a9d23df3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad319032bd1545259b38d7c6ba18d06c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:31.829048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 918/1830] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:31 2022] DELETE /identity/v3/users/ad319032bd1545259b38d7c6ba18d06c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:32.128088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:32.129767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:32.153585 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93eda3-cb7d-497f-ba85-5e6f8f796209 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:32.211390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:32.212251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.212531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.213293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] PATH_INFO: `/v3/projects/509d939f811d497985b40861e50f1f60` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.214528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=509d939f811d497985b40861e50f1f60)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:32.216452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:32.274970 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509d939f811d497985b40861e50f1f60', 'request_id': 'req-05783cba-c19e-4aee-9ace-ba505351a54a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:32.281631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509d939f811d497985b40861e50f1f60', 'request_id': 'req-05783cba-c19e-4aee-9ace-ba505351a54a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:32.289140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509d939f811d497985b40861e50f1f60', 'request_id': 'req-05783cba-c19e-4aee-9ace-ba505351a54a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:32.300719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] The token cache is being invalidate because project 509d939f811d497985b40861e50f1f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:32.301122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:32.301768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05783cba-c19e-4aee-9ace-ba505351a54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:32.303334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 913/1831] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:32 2022] DELETE /identity/v3/projects/509d939f811d497985b40861e50f1f60 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:32.308180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb89b8-57ef-4f68-93eb-3054389cd993 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.308550 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb89b8-57ef-4f68-93eb-3054389cd993 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.309306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb89b8-57ef-4f68-93eb-3054389cd993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.327989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f6fb89b8-57ef-4f68-93eb-3054389cd993 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:32.329194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f6fb89b8-57ef-4f68-93eb-3054389cd993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:32.394392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 919/1832] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:32.402839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d8ca8-6dfd-41a4-aa8e-72383d5c21d8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.403126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d8ca8-6dfd-41a4-aa8e-72383d5c21d8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.403625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d8ca8-6dfd-41a4-aa8e-72383d5c21d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.422747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ca8d8ca8-6dfd-41a4-aa8e-72383d5c21d8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:32.423982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ca8d8ca8-6dfd-41a4-aa8e-72383d5c21d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:32.433970 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 914/1833] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:32.438049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb89b8-57ef-4f68-93eb-3054389cd993 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:32.449695 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb89b8-57ef-4f68-93eb-3054389cd993 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:32.456426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9156a9-e59f-43ee-868b-1efce6284790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:32.457365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9156a9-e59f-43ee-868b-1efce6284790 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.457938 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9156a9-e59f-43ee-868b-1efce6284790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.458435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9156a9-e59f-43ee-868b-1efce6284790 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.459418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9156a9-e59f-43ee-868b-1efce6284790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:42:32.459899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9156a9-e59f-43ee-868b-1efce6284790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:32.463821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9156a9-e59f-43ee-868b-1efce6284790 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:32.479725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 920/1834] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:42:32.484650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d8ca8-6dfd-41a4-aa8e-72383d5c21d8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:32.494917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d8ca8-6dfd-41a4-aa8e-72383d5c21d8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:32.500976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589928-1472-4f95-86bc-bba41f0f56a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:32.501788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589928-1472-4f95-86bc-bba41f0f56a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.502289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589928-1472-4f95-86bc-bba41f0f56a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.502757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589928-1472-4f95-86bc-bba41f0f56a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.504763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f589928-1472-4f95-86bc-bba41f0f56a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:32.507056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f589928-1472-4f95-86bc-bba41f0f56a7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:32.549248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 915/1835] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:32 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:32.553133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9156a9-e59f-43ee-868b-1efce6284790 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:32.568929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9156a9-e59f-43ee-868b-1efce6284790 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:32.690228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72613f-8bd6-4a1e-86f9-95979b4049fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:32.690883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72613f-8bd6-4a1e-86f9-95979b4049fb admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.692386 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72613f-8bd6-4a1e-86f9-95979b4049fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.692986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72613f-8bd6-4a1e-86f9-95979b4049fb admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.693955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72613f-8bd6-4a1e-86f9-95979b4049fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:32.696177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72613f-8bd6-4a1e-86f9-95979b4049fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:32.747187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 921/1836] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:32 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:32.750929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589928-1472-4f95-86bc-bba41f0f56a7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:32.761981 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589928-1472-4f95-86bc-bba41f0f56a7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:32.767247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83caa6-2a83-4a17-a6f5-480baa887e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:32.768128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83caa6-2a83-4a17-a6f5-480baa887e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.768702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83caa6-2a83-4a17-a6f5-480baa887e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.769081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83caa6-2a83-4a17-a6f5-480baa887e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.770068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83caa6-2a83-4a17-a6f5-480baa887e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:32.771822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83caa6-2a83-4a17-a6f5-480baa887e4e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:32.783379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 916/1837] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:32.787542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72613f-8bd6-4a1e-86f9-95979b4049fb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:32.797720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72613f-8bd6-4a1e-86f9-95979b4049fb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:32.802376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbb5a9-19d7-4c0c-904a-553b42fa602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:32.803025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb5a9-19d7-4c0c-904a-553b42fa602f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.803308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb5a9-19d7-4c0c-904a-553b42fa602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.803580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb5a9-19d7-4c0c-904a-553b42fa602f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.804299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbb5a9-19d7-4c0c-904a-553b42fa602f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:32.805874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbb5a9-19d7-4c0c-904a-553b42fa602f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:32.817621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 922/1838] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:42:32.821604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83caa6-2a83-4a17-a6f5-480baa887e4e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:32.834473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83caa6-2a83-4a17-a6f5-480baa887e4e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:32.839187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e7362-2872-4dc4-b8d3-bacdd79db84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:32.840076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7362-2872-4dc4-b8d3-bacdd79db84f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.840359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7362-2872-4dc4-b8d3-bacdd79db84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.840636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7362-2872-4dc4-b8d3-bacdd79db84f admin admin] PATH_INFO: `/v3/projects/36cc5a8d28d64d8bbe825530d233db09/users/af02f94ece53479d92df68ab51610d39/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.858223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e7362-2872-4dc4-b8d3-bacdd79db84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cc5a8d28d64d8bbe825530d233db09, user_id=af02f94ece53479d92df68ab51610d39, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:32.861084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e7362-2872-4dc4-b8d3-bacdd79db84f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:32.883535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 917/1839] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:32 2022] PUT /identity/v3/projects/36cc5a8d28d64d8bbe825530d233db09/users/af02f94ece53479d92df68ab51610d39/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:32.897749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a50256-62d7-4015-a3fb-3a7c3c04c941 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:32.898056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a50256-62d7-4015-a3fb-3a7c3c04c941 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:32.899017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a50256-62d7-4015-a3fb-3a7c3c04c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:32.935110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-12a50256-62d7-4015-a3fb-3a7c3c04c941 None None] MFA Rules not processed for user `af02f94ece53479d92df68ab51610d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:32.935916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-12a50256-62d7-4015-a3fb-3a7c3c04c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:33.026841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 923/1840] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:33.030789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e7362-2872-4dc4-b8d3-bacdd79db84f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:33.107276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e7362-2872-4dc4-b8d3-bacdd79db84f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:33.112090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaedfb-d0f4-4ecd-be44-ac69c94c53ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:33.112754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaedfb-d0f4-4ecd-be44-ac69c94c53ab admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:33.113036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaedfb-d0f4-4ecd-be44-ac69c94c53ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:33.113312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaedfb-d0f4-4ecd-be44-ac69c94c53ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:33.114025 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdaedfb-d0f4-4ecd-be44-ac69c94c53ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:33.115950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdaedfb-d0f4-4ecd-be44-ac69c94c53ab admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:33.143712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 918/1841] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:33 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:42:33.148893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a50256-62d7-4015-a3fb-3a7c3c04c941 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:33.160323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a50256-62d7-4015-a3fb-3a7c3c04c941 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:33.218009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d11e3-c466-4d40-83ce-a0c8a0499be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:33.218697 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d11e3-c466-4d40-83ce-a0c8a0499be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:33.218982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d11e3-c466-4d40-83ce-a0c8a0499be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:33.219259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d11e3-c466-4d40-83ce-a0c8a0499be2 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:33.219961 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d11e3-c466-4d40-83ce-a0c8a0499be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:33.221880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d11e3-c466-4d40-83ce-a0c8a0499be2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:33.241913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 924/1842] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:33 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:42:33.246461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaedfb-d0f4-4ecd-be44-ac69c94c53ab admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:33.256527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaedfb-d0f4-4ecd-be44-ac69c94c53ab admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:33.261246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032421f-011b-4333-834d-abf6cf10ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:33.261901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032421f-011b-4333-834d-abf6cf10ac74 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:33.262225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032421f-011b-4333-834d-abf6cf10ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:33.262503 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032421f-011b-4333-834d-abf6cf10ac74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:33.263255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032421f-011b-4333-834d-abf6cf10ac74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:33.264890 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032421f-011b-4333-834d-abf6cf10ac74 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:33.276086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 919/1843] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:33.280280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d11e3-c466-4d40-83ce-a0c8a0499be2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:33.297463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d11e3-c466-4d40-83ce-a0c8a0499be2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:33.302450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634065d-c578-4cdd-be25-be79770a58d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:33.303333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634065d-c578-4cdd-be25-be79770a58d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:33.303649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634065d-c578-4cdd-be25-be79770a58d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:33.303945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634065d-c578-4cdd-be25-be79770a58d6 admin admin] PATH_INFO: `/v3/projects/79709fe8437a4f5fa8779ef5c06f2e82/users/b13deea152134adda3dcd761261b9b9d/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:33.319271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634065d-c578-4cdd-be25-be79770a58d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79709fe8437a4f5fa8779ef5c06f2e82, user_id=b13deea152134adda3dcd761261b9b9d, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:33.321967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634065d-c578-4cdd-be25-be79770a58d6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:33.335696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 925/1844] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:33 2022] PUT /identity/v3/projects/79709fe8437a4f5fa8779ef5c06f2e82/users/b13deea152134adda3dcd761261b9b9d/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:33.340044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032421f-011b-4333-834d-abf6cf10ac74 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:33.349972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032421f-011b-4333-834d-abf6cf10ac74 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:33.414530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b44c3a-52b8-494e-b02b-1d534fb919b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:33.415262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b44c3a-52b8-494e-b02b-1d534fb919b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:33.415624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b44c3a-52b8-494e-b02b-1d534fb919b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:33.416520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b44c3a-52b8-494e-b02b-1d534fb919b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:33.417323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b44c3a-52b8-494e-b02b-1d534fb919b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:33.418955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b44c3a-52b8-494e-b02b-1d534fb919b9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:33.428820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 920/1845] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:33.433473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634065d-c578-4cdd-be25-be79770a58d6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:33.443563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634065d-c578-4cdd-be25-be79770a58d6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:33.448124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccc35b-6598-4f94-a1b5-b429cae7f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:33.448986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc35b-6598-4f94-a1b5-b429cae7f58f admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:33.449263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc35b-6598-4f94-a1b5-b429cae7f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:33.449534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc35b-6598-4f94-a1b5-b429cae7f58f admin admin] PATH_INFO: `/v3/projects/79709fe8437a4f5fa8779ef5c06f2e82/users/b13deea152134adda3dcd761261b9b9d/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:33.451514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccc35b-6598-4f94-a1b5-b429cae7f58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79709fe8437a4f5fa8779ef5c06f2e82, user_id=b13deea152134adda3dcd761261b9b9d, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:33.454162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccc35b-6598-4f94-a1b5-b429cae7f58f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:33.467060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 926/1846] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:33 2022] PUT /identity/v3/projects/79709fe8437a4f5fa8779ef5c06f2e82/users/b13deea152134adda3dcd761261b9b9d/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:33.477314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05e12-5174-438a-b03e-23a5bfd9c5a8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:33.477598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05e12-5174-438a-b03e-23a5bfd9c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:33.477904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05e12-5174-438a-b03e-23a5bfd9c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:33.503553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-00b05e12-5174-438a-b03e-23a5bfd9c5a8 None None] MFA Rules not processed for user `b13deea152134adda3dcd761261b9b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:33.504748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-00b05e12-5174-438a-b03e-23a5bfd9c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:33.570546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 921/1847] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:33.581963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccc35b-6598-4f94-a1b5-b429cae7f58f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:33.583683 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8bccc35b-6598-4f94-a1b5-b429cae7f58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:33.640230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccc35b-6598-4f94-a1b5-b429cae7f58f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:33.643833 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee41b5-0cae-4e95-8737-ba9c2061b773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:33.644469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee41b5-0cae-4e95-8737-ba9c2061b773 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:33.644747 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee41b5-0cae-4e95-8737-ba9c2061b773 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:33.645014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee41b5-0cae-4e95-8737-ba9c2061b773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:33.654367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee41b5-0cae-4e95-8737-ba9c2061b773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:33.655806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee41b5-0cae-4e95-8737-ba9c2061b773 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:33.664952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 927/1848] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:33.782341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b05e12-5174-438a-b03e-23a5bfd9c5a8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:33.793190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b05e12-5174-438a-b03e-23a5bfd9c5a8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:33.798828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a190c4-66e0-4f89-9c69-9df040655c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:33.799564 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a190c4-66e0-4f89-9c69-9df040655c10 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:33.799845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a190c4-66e0-4f89-9c69-9df040655c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:33.800112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a190c4-66e0-4f89-9c69-9df040655c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:33.861302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a190c4-66e0-4f89-9c69-9df040655c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:33.862741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a190c4-66e0-4f89-9c69-9df040655c10 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:33.872520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 922/1849] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:34.226939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11581e1f-629d-4fd5-9ad2-bd3c4afed564 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:34.227826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11581e1f-629d-4fd5-9ad2-bd3c4afed564 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:34.228300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11581e1f-629d-4fd5-9ad2-bd3c4afed564 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:34.232234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 928/1850] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:42:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:42:34.255844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4ab9-a302-4169-b943-db74dab52319 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:34.256416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4ab9-a302-4169-b943-db74dab52319 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:34.256878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4ab9-a302-4169-b943-db74dab52319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:34.295488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-071e4ab9-a302-4169-b943-db74dab52319 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:34.297183 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-071e4ab9-a302-4169-b943-db74dab52319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:34.389878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 923/1851] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:34.453393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11581e1f-629d-4fd5-9ad2-bd3c4afed564 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:34.456046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-11581e1f-629d-4fd5-9ad2-bd3c4afed564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:34.473416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11581e1f-629d-4fd5-9ad2-bd3c4afed564 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:34.483340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa705fa-ec6f-4b1c-8fbd-fea6c7c2c4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:34.483996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa705fa-ec6f-4b1c-8fbd-fea6c7c2c4cc service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:34.484281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa705fa-ec6f-4b1c-8fbd-fea6c7c2c4cc service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:34.484557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa705fa-ec6f-4b1c-8fbd-fea6c7c2c4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:34.495755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa705fa-ec6f-4b1c-8fbd-fea6c7c2c4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:34.497334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa705fa-ec6f-4b1c-8fbd-fea6c7c2c4cc service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:34.508153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 929/1852] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:42.741290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4ab9-a302-4169-b943-db74dab52319 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:42.809725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4ab9-a302-4169-b943-db74dab52319 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:42.815092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:42.816059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:42.816415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:42.816764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] PATH_INFO: `/v3/users/af02f94ece53479d92df68ab51610d39` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:42.818074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=af02f94ece53479d92df68ab51610d39)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:42.820085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:42.875180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af02f94ece53479d92df68ab51610d39'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:42.889373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af02f94ece53479d92df68ab51610d39'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:42.890225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af02f94ece53479d92df68ab51610d39'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:42.890852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af02f94ece53479d92df68ab51610d39'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:42.899755 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af02f94ece53479d92df68ab51610d39'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:42.918923 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 924/1853] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:42 2022] DELETE /identity/v3/users/af02f94ece53479d92df68ab51610d39 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:42:42.923280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456ed41-3acb-4f71-b975-c091cbc22e97 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:42.923746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456ed41-3acb-4f71-b975-c091cbc22e97 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:42.923938 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456ed41-3acb-4f71-b975-c091cbc22e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:42.943690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3456ed41-3acb-4f71-b975-c091cbc22e97 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:42.945028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3456ed41-3acb-4f71-b975-c091cbc22e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:43.015573 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 930/1854] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:43.035615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:43.037321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:43.101167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caaeca-a0c6-4999-9f66-84143da922dd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:43.106018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f40f6f-2602-4ff8-8684-fde778771294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:43.106842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f40f6f-2602-4ff8-8684-fde778771294 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:43.107218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f40f6f-2602-4ff8-8684-fde778771294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:43.107589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f40f6f-2602-4ff8-8684-fde778771294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:43.117480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f40f6f-2602-4ff8-8684-fde778771294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:43.119657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f40f6f-2602-4ff8-8684-fde778771294 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:43.131684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 925/1855] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:43.392226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456ed41-3acb-4f71-b975-c091cbc22e97 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:43.393356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3456ed41-3acb-4f71-b975-c091cbc22e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:43.405233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456ed41-3acb-4f71-b975-c091cbc22e97 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:43.410548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:43.411402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:43.411678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:43.411946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] PATH_INFO: `/v3/projects/36cc5a8d28d64d8bbe825530d233db09` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:43.413129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cc5a8d28d64d8bbe825530d233db09)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:43.415618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:43.466101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cc5a8d28d64d8bbe825530d233db09', 'request_id': 'req-fd657730-ac94-40a2-89e3-3a9e29d98f50'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.472502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cc5a8d28d64d8bbe825530d233db09', 'request_id': 'req-fd657730-ac94-40a2-89e3-3a9e29d98f50'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.480763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cc5a8d28d64d8bbe825530d233db09', 'request_id': 'req-fd657730-ac94-40a2-89e3-3a9e29d98f50'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.491286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] The token cache is being invalidate because project 36cc5a8d28d64d8bbe825530d233db09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:43.491569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.492211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.493883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 931/1856] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:43 2022] DELETE /identity/v3/projects/36cc5a8d28d64d8bbe825530d233db09 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:43.497863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f40f6f-2602-4ff8-8684-fde778771294 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:43.507569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f40f6f-2602-4ff8-8684-fde778771294 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:43.564930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:43.565804 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:43.566116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:43.566391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] PATH_INFO: `/v3/users/b13deea152134adda3dcd761261b9b9d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:43.567684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13deea152134adda3dcd761261b9b9d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:43.569758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:43.616897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13deea152134adda3dcd761261b9b9d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.628996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13deea152134adda3dcd761261b9b9d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.629680 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13deea152134adda3dcd761261b9b9d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.630305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13deea152134adda3dcd761261b9b9d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.639278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09feaa33-6056-472f-9b64-0a5ba2ecb9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13deea152134adda3dcd761261b9b9d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:43.658687 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 926/1857] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:42:43 2022] DELETE /identity/v3/users/b13deea152134adda3dcd761261b9b9d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:43.934953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:43.937051 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:43.957906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd657730-ac94-40a2-89e3-3a9e29d98f50 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.017174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.018297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.018725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.018996 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] PATH_INFO: `/v3/projects/79709fe8437a4f5fa8779ef5c06f2e82` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.020217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=79709fe8437a4f5fa8779ef5c06f2e82)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.022161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.071011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79709fe8437a4f5fa8779ef5c06f2e82', 'request_id': 'req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:44.077616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79709fe8437a4f5fa8779ef5c06f2e82', 'request_id': 'req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:44.084407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79709fe8437a4f5fa8779ef5c06f2e82', 'request_id': 'req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:44.094558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] The token cache is being invalidate because project 79709fe8437a4f5fa8779ef5c06f2e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:42:44.094843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:44.095468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a8c6079-4b11-4a42-8e32-a6ce69c401fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:42:44.097050 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 932/1858] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:42:43 2022] DELETE /identity/v3/projects/79709fe8437a4f5fa8779ef5c06f2e82 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:44.102169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad07d7-5490-49e2-9321-6d9039b655ae None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.102663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad07d7-5490-49e2-9321-6d9039b655ae None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.102766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad07d7-5490-49e2-9321-6d9039b655ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.121459 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ecad07d7-5490-49e2-9321-6d9039b655ae None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:44.122720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ecad07d7-5490-49e2-9321-6d9039b655ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:44.189449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 927/1859] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:44.191134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b75fd-cb87-4d63-a5f3-9a08a7757975 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.191429 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b75fd-cb87-4d63-a5f3-9a08a7757975 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.191706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b75fd-cb87-4d63-a5f3-9a08a7757975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.211326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5c1b75fd-cb87-4d63-a5f3-9a08a7757975 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:44.212719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5c1b75fd-cb87-4d63-a5f3-9a08a7757975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:44.220947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 933/1860] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:44.225097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad07d7-5490-49e2-9321-6d9039b655ae None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.237429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad07d7-5490-49e2-9321-6d9039b655ae None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.242324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a94b6c-552e-48ce-972d-beeccd1471ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.243080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a94b6c-552e-48ce-972d-beeccd1471ba admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.243371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a94b6c-552e-48ce-972d-beeccd1471ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.244215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a94b6c-552e-48ce-972d-beeccd1471ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.244942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a94b6c-552e-48ce-972d-beeccd1471ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:42:44.245245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a94b6c-552e-48ce-972d-beeccd1471ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.246885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a94b6c-552e-48ce-972d-beeccd1471ba admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.261835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 928/1861] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:42:44.262934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b75fd-cb87-4d63-a5f3-9a08a7757975 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.272134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b75fd-cb87-4d63-a5f3-9a08a7757975 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.276946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373b37-b5a5-49b7-b3db-c0ae25049355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.277609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373b37-b5a5-49b7-b3db-c0ae25049355 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.277894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373b37-b5a5-49b7-b3db-c0ae25049355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.278214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373b37-b5a5-49b7-b3db-c0ae25049355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.278910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07373b37-b5a5-49b7-b3db-c0ae25049355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.280847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07373b37-b5a5-49b7-b3db-c0ae25049355 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.308138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 934/1862] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:44 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:42:44.315309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a94b6c-552e-48ce-972d-beeccd1471ba admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.325235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a94b6c-552e-48ce-972d-beeccd1471ba admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.380647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9482d-c79e-4ec5-b295-0a71da81590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.381309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9482d-c79e-4ec5-b295-0a71da81590b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.381588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9482d-c79e-4ec5-b295-0a71da81590b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.381858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9482d-c79e-4ec5-b295-0a71da81590b admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.382566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9482d-c79e-4ec5-b295-0a71da81590b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.384485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9482d-c79e-4ec5-b295-0a71da81590b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.406784 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 929/1863] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:44 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:44.411057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373b37-b5a5-49b7-b3db-c0ae25049355 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.426758 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373b37-b5a5-49b7-b3db-c0ae25049355 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.432658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5895a-e189-4a74-bfef-0086b25ddf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.433325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5895a-e189-4a74-bfef-0086b25ddf16 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.433608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5895a-e189-4a74-bfef-0086b25ddf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.433885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5895a-e189-4a74-bfef-0086b25ddf16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.434723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5895a-e189-4a74-bfef-0086b25ddf16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.436327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5895a-e189-4a74-bfef-0086b25ddf16 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.446696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 935/1864] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:44.451030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9482d-c79e-4ec5-b295-0a71da81590b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.461684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9482d-c79e-4ec5-b295-0a71da81590b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.466491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93f1f-6273-4787-bb22-1334351c407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.467182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93f1f-6273-4787-bb22-1334351c407c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.467465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93f1f-6273-4787-bb22-1334351c407c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.467741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93f1f-6273-4787-bb22-1334351c407c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.468458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c93f1f-6273-4787-bb22-1334351c407c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.470119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c93f1f-6273-4787-bb22-1334351c407c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.480938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 930/1865] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:44.485114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5895a-e189-4a74-bfef-0086b25ddf16 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.496081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5895a-e189-4a74-bfef-0086b25ddf16 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.500795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e344b-fa23-4444-8e99-dae38711c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.501704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e344b-fa23-4444-8e99-dae38711c781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.502020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e344b-fa23-4444-8e99-dae38711c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.502293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e344b-fa23-4444-8e99-dae38711c781 admin admin] PATH_INFO: `/v3/projects/dee3c27631694c6093b9a91d196b0f1a/users/58f0ec34d5e5452b9e9fb58d6ef33868/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.516273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e344b-fa23-4444-8e99-dae38711c781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee3c27631694c6093b9a91d196b0f1a, user_id=58f0ec34d5e5452b9e9fb58d6ef33868, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.518974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e344b-fa23-4444-8e99-dae38711c781 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.531329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 936/1866] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:44 2022] PUT /identity/v3/projects/dee3c27631694c6093b9a91d196b0f1a/users/58f0ec34d5e5452b9e9fb58d6ef33868/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:44.542825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cad256-b517-4bcf-ae60-326c72cc5a39 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.543120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cad256-b517-4bcf-ae60-326c72cc5a39 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.543406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cad256-b517-4bcf-ae60-326c72cc5a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.570758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-80cad256-b517-4bcf-ae60-326c72cc5a39 None None] MFA Rules not processed for user `58f0ec34d5e5452b9e9fb58d6ef33868`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:44.571942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-80cad256-b517-4bcf-ae60-326c72cc5a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:44.633537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 931/1867] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:44.638114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e344b-fa23-4444-8e99-dae38711c781 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.702824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e344b-fa23-4444-8e99-dae38711c781 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.708641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347903-6ffc-4442-874e-2687688bd411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.709301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347903-6ffc-4442-874e-2687688bd411 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.709584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347903-6ffc-4442-874e-2687688bd411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.709862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347903-6ffc-4442-874e-2687688bd411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.710597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a347903-6ffc-4442-874e-2687688bd411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.713020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a347903-6ffc-4442-874e-2687688bd411 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.738698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 937/1868] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:42:44 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:42:44.744725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cad256-b517-4bcf-ae60-326c72cc5a39 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.767239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cad256-b517-4bcf-ae60-326c72cc5a39 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.825611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269f211-c4b9-457c-ae8a-fe5fb2ea8bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.826437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269f211-c4b9-457c-ae8a-fe5fb2ea8bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.826792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269f211-c4b9-457c-ae8a-fe5fb2ea8bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.827189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269f211-c4b9-457c-ae8a-fe5fb2ea8bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.827936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269f211-c4b9-457c-ae8a-fe5fb2ea8bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.829971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269f211-c4b9-457c-ae8a-fe5fb2ea8bd5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.850919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 932/1869] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:42:44 2022] POST /identity/v3/users => generated 310 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:42:44.855889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347903-6ffc-4442-874e-2687688bd411 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.866101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347903-6ffc-4442-874e-2687688bd411 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.870704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76114ab-bda1-41c8-aa4e-d7b25a43f00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.871394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76114ab-bda1-41c8-aa4e-d7b25a43f00a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.871680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76114ab-bda1-41c8-aa4e-d7b25a43f00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.871953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76114ab-bda1-41c8-aa4e-d7b25a43f00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.873796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76114ab-bda1-41c8-aa4e-d7b25a43f00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.874298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76114ab-bda1-41c8-aa4e-d7b25a43f00a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.888162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 938/1870] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:44.889457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269f211-c4b9-457c-ae8a-fe5fb2ea8bd5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.903206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269f211-c4b9-457c-ae8a-fe5fb2ea8bd5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:44.908061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef08813-9d2f-4fbe-8192-9c4f07a28135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:44.908985 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef08813-9d2f-4fbe-8192-9c4f07a28135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:44.909269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef08813-9d2f-4fbe-8192-9c4f07a28135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:44.909549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef08813-9d2f-4fbe-8192-9c4f07a28135 admin admin] PATH_INFO: `/v3/projects/b76299cc11d64d5b8250ee45ede7e3ef/users/ddecda8844f94b54a45dae642c6352af/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:44.924921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef08813-9d2f-4fbe-8192-9c4f07a28135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76299cc11d64d5b8250ee45ede7e3ef, user_id=ddecda8844f94b54a45dae642c6352af, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:44.927615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef08813-9d2f-4fbe-8192-9c4f07a28135 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:44.940380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 933/1871] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:44 2022] PUT /identity/v3/projects/b76299cc11d64d5b8250ee45ede7e3ef/users/ddecda8844f94b54a45dae642c6352af/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:44.944525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76114ab-bda1-41c8-aa4e-d7b25a43f00a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:44.954859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76114ab-bda1-41c8-aa4e-d7b25a43f00a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:45.009646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43547e0d-44bc-4cf8-9401-f870d26fa866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:45.010306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43547e0d-44bc-4cf8-9401-f870d26fa866 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:45.010592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43547e0d-44bc-4cf8-9401-f870d26fa866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:45.010869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43547e0d-44bc-4cf8-9401-f870d26fa866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:45.011585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43547e0d-44bc-4cf8-9401-f870d26fa866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:45.013176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43547e0d-44bc-4cf8-9401-f870d26fa866 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:45.022462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 939/1872] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:42:45.027319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef08813-9d2f-4fbe-8192-9c4f07a28135 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:45.037278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef08813-9d2f-4fbe-8192-9c4f07a28135 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:45.041845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8006bc-3af4-4c88-a470-a5f58ef7f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:45.042829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8006bc-3af4-4c88-a470-a5f58ef7f48e admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:45.043112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8006bc-3af4-4c88-a470-a5f58ef7f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:45.043382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8006bc-3af4-4c88-a470-a5f58ef7f48e admin admin] PATH_INFO: `/v3/projects/b76299cc11d64d5b8250ee45ede7e3ef/users/ddecda8844f94b54a45dae642c6352af/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:45.045308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8006bc-3af4-4c88-a470-a5f58ef7f48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76299cc11d64d5b8250ee45ede7e3ef, user_id=ddecda8844f94b54a45dae642c6352af, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:45.047956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8006bc-3af4-4c88-a470-a5f58ef7f48e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:45.057946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 934/1873] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:42:45 2022] PUT /identity/v3/projects/b76299cc11d64d5b8250ee45ede7e3ef/users/ddecda8844f94b54a45dae642c6352af/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:42:45.068598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3314-3701-4b5c-854a-103c5fd8f7a7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:45.068887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3314-3701-4b5c-854a-103c5fd8f7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:45.069158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3314-3701-4b5c-854a-103c5fd8f7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:45.099534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4e5b3314-3701-4b5c-854a-103c5fd8f7a7 None None] MFA Rules not processed for user `ddecda8844f94b54a45dae642c6352af`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:45.100765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4e5b3314-3701-4b5c-854a-103c5fd8f7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:45.176660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 940/1874] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:42:45 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:45.188058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8006bc-3af4-4c88-a470-a5f58ef7f48e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:45.189935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ea8006bc-3af4-4c88-a470-a5f58ef7f48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:45.249191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8006bc-3af4-4c88-a470-a5f58ef7f48e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:45.252815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240fea2-9baf-4788-897e-d51601758f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:45.253487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240fea2-9baf-4788-897e-d51601758f3d service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:45.253777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240fea2-9baf-4788-897e-d51601758f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:45.254090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240fea2-9baf-4788-897e-d51601758f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:45.263437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240fea2-9baf-4788-897e-d51601758f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:45.264815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240fea2-9baf-4788-897e-d51601758f3d service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:45.274116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 935/1875] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:45 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:45.433402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3314-3701-4b5c-854a-103c5fd8f7a7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:45.442619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3314-3701-4b5c-854a-103c5fd8f7a7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:45.446200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c22717-8fd8-4d12-922a-5cc805ea2ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:45.447401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c22717-8fd8-4d12-922a-5cc805ea2ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:45.447684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c22717-8fd8-4d12-922a-5cc805ea2ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:45.447957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c22717-8fd8-4d12-922a-5cc805ea2ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:45.506276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c22717-8fd8-4d12-922a-5cc805ea2ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:45.507718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c22717-8fd8-4d12-922a-5cc805ea2ba4 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:45.518152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 941/1876] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:42:49.523352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e102e-4ac1-4bfa-aea8-bd4b50c17781 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:49.523352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e102e-4ac1-4bfa-aea8-bd4b50c17781 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:49.523352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e102e-4ac1-4bfa-aea8-bd4b50c17781 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:49.523352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 936/1877] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:42:49.528471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35720e8a-d93c-4ae2-8615-369cb5091f16 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:49.528925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35720e8a-d93c-4ae2-8615-369cb5091f16 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:49.529072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35720e8a-d93c-4ae2-8615-369cb5091f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:49.548334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-35720e8a-d93c-4ae2-8615-369cb5091f16 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:42:49.549646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-35720e8a-d93c-4ae2-8615-369cb5091f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:49.616803 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 942/1878] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:42:49.630259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e102e-4ac1-4bfa-aea8-bd4b50c17781 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:42:49.632068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-401e102e-4ac1-4bfa-aea8-bd4b50c17781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:42:49.652881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e102e-4ac1-4bfa-aea8-bd4b50c17781 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:42:49.658975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c757d33-ef9c-4b44-a448-fcc991b8a703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:42:49.659617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c757d33-ef9c-4b44-a448-fcc991b8a703 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:42:49.659902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c757d33-ef9c-4b44-a448-fcc991b8a703 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:42:49.660179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c757d33-ef9c-4b44-a448-fcc991b8a703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:42:49.670656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c757d33-ef9c-4b44-a448-fcc991b8a703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:42:49.672561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c757d33-ef9c-4b44-a448-fcc991b8a703 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:42:49.683546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 937/1879] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:42:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:02.316454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35720e8a-d93c-4ae2-8615-369cb5091f16 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:02.429085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35720e8a-d93c-4ae2-8615-369cb5091f16 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:02.437268 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:02.439059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:02.439349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:02.439627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] PATH_INFO: `/v3/users/58f0ec34d5e5452b9e9fb58d6ef33868` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:02.440889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f0ec34d5e5452b9e9fb58d6ef33868)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:02.442851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:02.497285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f0ec34d5e5452b9e9fb58d6ef33868'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:02.517555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f0ec34d5e5452b9e9fb58d6ef33868'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:02.518398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f0ec34d5e5452b9e9fb58d6ef33868'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:02.532019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f0ec34d5e5452b9e9fb58d6ef33868'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:02.540735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f0ec34d5e5452b9e9fb58d6ef33868'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:02.548510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 943/1880] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:02 2022] DELETE /identity/v3/users/58f0ec34d5e5452b9e9fb58d6ef33868 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:02.553204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349c90-87d2-4750-881d-50bc4935a198 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:02.553746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349c90-87d2-4750-881d-50bc4935a198 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:02.553746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349c90-87d2-4750-881d-50bc4935a198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:02.582451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dc349c90-87d2-4750-881d-50bc4935a198 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:02.583988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dc349c90-87d2-4750-881d-50bc4935a198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:02.659739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 938/1881] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:02.669392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:02.671033 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:02.730029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee492a-42ea-41a5-8446-962c30be5d96 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:02.733655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81167-d033-4a15-b18a-3995eddbbd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:02.734335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81167-d033-4a15-b18a-3995eddbbd0f service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:02.734617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81167-d033-4a15-b18a-3995eddbbd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:02.734896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81167-d033-4a15-b18a-3995eddbbd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:02.744850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a81167-d033-4a15-b18a-3995eddbbd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:02.746436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a81167-d033-4a15-b18a-3995eddbbd0f service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:02.756159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 944/1882] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:03.551158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349c90-87d2-4750-881d-50bc4935a198 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:03.552798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dc349c90-87d2-4750-881d-50bc4935a198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:03.583977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349c90-87d2-4750-881d-50bc4935a198 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:03.590172 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:03.591043 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:03.591333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:03.591587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] PATH_INFO: `/v3/projects/dee3c27631694c6093b9a91d196b0f1a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:03.592887 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee3c27631694c6093b9a91d196b0f1a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:03.594864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:03.653527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee3c27631694c6093b9a91d196b0f1a', 'request_id': 'req-8bf6021c-f7e9-476f-8432-4060d0e8bb27'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.660863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee3c27631694c6093b9a91d196b0f1a', 'request_id': 'req-8bf6021c-f7e9-476f-8432-4060d0e8bb27'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.673353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee3c27631694c6093b9a91d196b0f1a', 'request_id': 'req-8bf6021c-f7e9-476f-8432-4060d0e8bb27'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.691209 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] The token cache is being invalidate because project dee3c27631694c6093b9a91d196b0f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:03.691497 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.692156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.693956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 939/1883] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:03 2022] DELETE /identity/v3/projects/dee3c27631694c6093b9a91d196b0f1a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:03.698364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81167-d033-4a15-b18a-3995eddbbd0f service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:03.709717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81167-d033-4a15-b18a-3995eddbbd0f service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:03.768583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:03.769452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:03.769728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:03.770025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] PATH_INFO: `/v3/users/ddecda8844f94b54a45dae642c6352af` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:03.771233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddecda8844f94b54a45dae642c6352af)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:03.773392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:03.820548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddecda8844f94b54a45dae642c6352af'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.831976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddecda8844f94b54a45dae642c6352af'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.832655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddecda8844f94b54a45dae642c6352af'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.839325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddecda8844f94b54a45dae642c6352af'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.847079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ef148c07-04cc-45a3-b01d-df70364bad90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddecda8844f94b54a45dae642c6352af'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:03.854397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 945/1884] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:03 2022] DELETE /identity/v3/users/ddecda8844f94b54a45dae642c6352af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:04.187761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:04.189187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:04.202969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6021c-f7e9-476f-8432-4060d0e8bb27 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:04.261949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:04.262841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.263118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.263387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] PATH_INFO: `/v3/projects/b76299cc11d64d5b8250ee45ede7e3ef` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.265546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76299cc11d64d5b8250ee45ede7e3ef)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:04.267502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:04.312883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76299cc11d64d5b8250ee45ede7e3ef', 'request_id': 'req-56d11ca6-3408-44e7-943b-3e85811fcc24'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.318646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76299cc11d64d5b8250ee45ede7e3ef', 'request_id': 'req-56d11ca6-3408-44e7-943b-3e85811fcc24'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.326170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76299cc11d64d5b8250ee45ede7e3ef', 'request_id': 'req-56d11ca6-3408-44e7-943b-3e85811fcc24'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.335720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] The token cache is being invalidate because project b76299cc11d64d5b8250ee45ede7e3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:04.335997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.336678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-56d11ca6-3408-44e7-943b-3e85811fcc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.338210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 940/1885] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:04 2022] DELETE /identity/v3/projects/b76299cc11d64d5b8250ee45ede7e3ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:04.343081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f808aaf-e808-4706-8419-571c9e0858c9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.343377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f808aaf-e808-4706-8419-571c9e0858c9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.343676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f808aaf-e808-4706-8419-571c9e0858c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.361250 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0f808aaf-e808-4706-8419-571c9e0858c9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:04.362498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0f808aaf-e808-4706-8419-571c9e0858c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:04.419305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 946/1886] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:04.427222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d08bca-0e59-42ff-b1cc-ee5a0600b2db None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.427515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d08bca-0e59-42ff-b1cc-ee5a0600b2db None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.427806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d08bca-0e59-42ff-b1cc-ee5a0600b2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.573586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e6d08bca-0e59-42ff-b1cc-ee5a0600b2db None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:04.574766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e6d08bca-0e59-42ff-b1cc-ee5a0600b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:04.582800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 941/1887] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:04.587176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f808aaf-e808-4706-8419-571c9e0858c9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:04.596706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f808aaf-e808-4706-8419-571c9e0858c9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:04.602074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721c95f-eaec-4f9d-ba1b-e7160fc02f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:04.603188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721c95f-eaec-4f9d-ba1b-e7160fc02f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.603474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721c95f-eaec-4f9d-ba1b-e7160fc02f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.603750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721c95f-eaec-4f9d-ba1b-e7160fc02f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.604492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721c95f-eaec-4f9d-ba1b-e7160fc02f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:04.604799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721c95f-eaec-4f9d-ba1b-e7160fc02f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:04.606439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721c95f-eaec-4f9d-ba1b-e7160fc02f4f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:04.611166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d08bca-0e59-42ff-b1cc-ee5a0600b2db None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:04.612589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e6d08bca-0e59-42ff-b1cc-ee5a0600b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:04.619315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 947/1888] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:43:04.623406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721c95f-eaec-4f9d-ba1b-e7160fc02f4f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:04.625157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d08bca-0e59-42ff-b1cc-ee5a0600b2db None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:04.629812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:04.630714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.630989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.631255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] PATH_INFO: `/v3/users/ff46ececf6a148268d33007b19dbc249` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.632435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff46ececf6a148268d33007b19dbc249)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:04.633187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721c95f-eaec-4f9d-ba1b-e7160fc02f4f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:04.634434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:04.637807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a64f-3332-43e9-95cb-7c09cedf7782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:04.638474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a64f-3332-43e9-95cb-7c09cedf7782 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.638761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a64f-3332-43e9-95cb-7c09cedf7782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.639039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a64f-3332-43e9-95cb-7c09cedf7782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.639721 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267a64f-3332-43e9-95cb-7c09cedf7782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:04.641578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267a64f-3332-43e9-95cb-7c09cedf7782 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:04.670048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 948/1889] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:04 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:04.674324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a64f-3332-43e9-95cb-7c09cedf7782 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:04.687563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff46ececf6a148268d33007b19dbc249'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.703643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff46ececf6a148268d33007b19dbc249'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.705049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff46ececf6a148268d33007b19dbc249'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.705953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff46ececf6a148268d33007b19dbc249'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.714735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2326cd6-ac1d-4f50-9fed-1fcd6d505b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff46ececf6a148268d33007b19dbc249'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:04.733218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 942/1890] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:04 2022] DELETE /identity/v3/users/ff46ececf6a148268d33007b19dbc249 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:04.738252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7e8d3-bfe5-4902-a057-e56d84132cdd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.738616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7e8d3-bfe5-4902-a057-e56d84132cdd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.738969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7e8d3-bfe5-4902-a057-e56d84132cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.747642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a64f-3332-43e9-95cb-7c09cedf7782 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:04.760737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e5a7e8d3-bfe5-4902-a057-e56d84132cdd None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:04.762303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e5a7e8d3-bfe5-4902-a057-e56d84132cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:04.836307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb9e5b-c505-482a-abd1-6e9d00a00b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:04.840521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb9e5b-c505-482a-abd1-6e9d00a00b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.840740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 943/1891] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:04.840817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb9e5b-c505-482a-abd1-6e9d00a00b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.840817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb9e5b-c505-482a-abd1-6e9d00a00b41 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.840817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb9e5b-c505-482a-abd1-6e9d00a00b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:04.841108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb9e5b-c505-482a-abd1-6e9d00a00b41 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:04.855022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7e8d3-bfe5-4902-a057-e56d84132cdd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:04.856579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e5a7e8d3-bfe5-4902-a057-e56d84132cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:04.864698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 949/1892] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:04 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:04.870904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb9e5b-c505-482a-abd1-6e9d00a00b41 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:04.873642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e3cb9e5b-c505-482a-abd1-6e9d00a00b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:04.890280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb9e5b-c505-482a-abd1-6e9d00a00b41 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:04.896560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d1820-8d37-41f9-8e3e-7aeec4cd2cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:04.897409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d1820-8d37-41f9-8e3e-7aeec4cd2cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.897849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d1820-8d37-41f9-8e3e-7aeec4cd2cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.898162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d1820-8d37-41f9-8e3e-7aeec4cd2cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.898899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d1820-8d37-41f9-8e3e-7aeec4cd2cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:04.900852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d1820-8d37-41f9-8e3e-7aeec4cd2cdd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:04.917314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 950/1893] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:04.918427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d1820-8d37-41f9-8e3e-7aeec4cd2cdd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:04.929100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d1820-8d37-41f9-8e3e-7aeec4cd2cdd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:04.936097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7e8d3-bfe5-4902-a057-e56d84132cdd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:04.939256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2972-2899-4d3d-b736-dcc9aec5a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:04.940046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2972-2899-4d3d-b736-dcc9aec5a1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.940722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8503c6f-b094-4bdb-9986-9aa5c8f44392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:04.940965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2972-2899-4d3d-b736-dcc9aec5a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.941375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503c6f-b094-4bdb-9986-9aa5c8f44392 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.941672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2972-2899-4d3d-b736-dcc9aec5a1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.941806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503c6f-b094-4bdb-9986-9aa5c8f44392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.942079 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503c6f-b094-4bdb-9986-9aa5c8f44392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:04.943767 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e2972-2899-4d3d-b736-dcc9aec5a1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:04.946688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e2972-2899-4d3d-b736-dcc9aec5a1c0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:04.954365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8503c6f-b094-4bdb-9986-9aa5c8f44392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:04.955282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8503c6f-b094-4bdb-9986-9aa5c8f44392 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:04.961473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 951/1894] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:04.966278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2972-2899-4d3d-b736-dcc9aec5a1c0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:04.968761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 944/1895] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:04.978235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2972-2899-4d3d-b736-dcc9aec5a1c0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:04.983275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe7dee-f55c-42be-be69-7e8f422b96e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:04.984409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe7dee-f55c-42be-be69-7e8f422b96e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:04.987450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe7dee-f55c-42be-be69-7e8f422b96e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:04.987916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe7dee-f55c-42be-be69-7e8f422b96e1 admin admin] PATH_INFO: `/v3/projects/847c2981691b48f18ae56c04afdf6cba/users/0f800b151a354b1ea4fb0cf0a56d6d56/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.008196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe7dee-f55c-42be-be69-7e8f422b96e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847c2981691b48f18ae56c04afdf6cba, user_id=0f800b151a354b1ea4fb0cf0a56d6d56, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:05.011073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe7dee-f55c-42be-be69-7e8f422b96e1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:05.042030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 952/1896] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:04 2022] PUT /identity/v3/projects/847c2981691b48f18ae56c04afdf6cba/users/0f800b151a354b1ea4fb0cf0a56d6d56/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:05.048105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2fff9-28f4-4178-8b26-d42f2810e042 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.048397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2fff9-28f4-4178-8b26-d42f2810e042 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.048731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2fff9-28f4-4178-8b26-d42f2810e042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.101468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-43d2fff9-28f4-4178-8b26-d42f2810e042 None None] MFA Rules not processed for user `0f800b151a354b1ea4fb0cf0a56d6d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:05.112290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-43d2fff9-28f4-4178-8b26-d42f2810e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:05.227219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 945/1897] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:05.232042 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe7dee-f55c-42be-be69-7e8f422b96e1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:05.319242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe7dee-f55c-42be-be69-7e8f422b96e1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:05.324698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a447200-468a-485a-9fb5-b937653847f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:05.325497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a447200-468a-485a-9fb5-b937653847f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.325784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a447200-468a-485a-9fb5-b937653847f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.326183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a447200-468a-485a-9fb5-b937653847f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.326795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a447200-468a-485a-9fb5-b937653847f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:05.328781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a447200-468a-485a-9fb5-b937653847f6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:05.353465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2fff9-28f4-4178-8b26-d42f2810e042 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:05.357454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-43d2fff9-28f4-4178-8b26-d42f2810e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:05.367320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 953/1898] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:05 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:05.371323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a447200-468a-485a-9fb5-b937653847f6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:05.377540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2fff9-28f4-4178-8b26-d42f2810e042 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:05.444300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a447200-468a-485a-9fb5-b937653847f6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:05.449211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:05.450270 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.450395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8cbc9-cabc-4f3a-84c1-54c180fc5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:05.450718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.451065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] PATH_INFO: `/v3/projects/d3379e9ffb88408781ad3728b8d76895` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.451346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8cbc9-cabc-4f3a-84c1-54c180fc5ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.451835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8cbc9-cabc-4f3a-84c1-54c180fc5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.452001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8cbc9-cabc-4f3a-84c1-54c180fc5ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.452523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3379e9ffb88408781ad3728b8d76895)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:05.452955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8cbc9-cabc-4f3a-84c1-54c180fc5ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:05.454592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:05.455066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8cbc9-cabc-4f3a-84c1-54c180fc5ed5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:05.476921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 954/1899] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:05 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:05.481020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8cbc9-cabc-4f3a-84c1-54c180fc5ed5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:05.490991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8cbc9-cabc-4f3a-84c1-54c180fc5ed5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:05.495553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54846ebc-9de8-4e9e-acb0-1af6081cc47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:05.496202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54846ebc-9de8-4e9e-acb0-1af6081cc47f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.496484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54846ebc-9de8-4e9e-acb0-1af6081cc47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.496761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54846ebc-9de8-4e9e-acb0-1af6081cc47f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.497510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54846ebc-9de8-4e9e-acb0-1af6081cc47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:05.499267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54846ebc-9de8-4e9e-acb0-1af6081cc47f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:05.504936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3379e9ffb88408781ad3728b8d76895', 'request_id': 'req-6492ea40-9c01-4033-b161-604cbd29b2b4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.509506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 955/1900] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:05.511850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3379e9ffb88408781ad3728b8d76895', 'request_id': 'req-6492ea40-9c01-4033-b161-604cbd29b2b4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.513437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54846ebc-9de8-4e9e-acb0-1af6081cc47f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:05.519972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3379e9ffb88408781ad3728b8d76895', 'request_id': 'req-6492ea40-9c01-4033-b161-604cbd29b2b4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.524811 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54846ebc-9de8-4e9e-acb0-1af6081cc47f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:05.531409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] The token cache is being invalidate because project d3379e9ffb88408781ad3728b8d76895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:05.531703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.532355 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.534067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 946/1901] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:05 2022] DELETE /identity/v3/projects/d3379e9ffb88408781ad3728b8d76895 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:05.537686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:05.539005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:05.583440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bff07-fb8f-4c1a-9a24-2d46c8f58338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:05.584152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bff07-fb8f-4c1a-9a24-2d46c8f58338 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.584439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bff07-fb8f-4c1a-9a24-2d46c8f58338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.584723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bff07-fb8f-4c1a-9a24-2d46c8f58338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.585520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bff07-fb8f-4c1a-9a24-2d46c8f58338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:05.587779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bff07-fb8f-4c1a-9a24-2d46c8f58338 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:05.598034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 956/1902] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:05.603872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bff07-fb8f-4c1a-9a24-2d46c8f58338 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:05.605772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d7bff07-fb8f-4c1a-9a24-2d46c8f58338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:05.618483 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bff07-fb8f-4c1a-9a24-2d46c8f58338 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:05.619773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ea40-9c01-4033-b161-604cbd29b2b4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:05.623517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603d2b8-8c31-472f-9128-12af8ac7b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:05.624474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603d2b8-8c31-472f-9128-12af8ac7b129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.624776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603d2b8-8c31-472f-9128-12af8ac7b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.625045 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:05.625227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603d2b8-8c31-472f-9128-12af8ac7b129 admin admin] PATH_INFO: `/v3/projects/176025eef5a54930a9b334699c6342b8/users/f7b69a952f024ad5bbc17ce592bc3cf5/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.625834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.626191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.626439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] PATH_INFO: `/v3/users/5ef2f2c1955349feb33d93e00bedbdac` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.627854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef2f2c1955349feb33d93e00bedbdac)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:05.629790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:05.641920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603d2b8-8c31-472f-9128-12af8ac7b129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176025eef5a54930a9b334699c6342b8, user_id=f7b69a952f024ad5bbc17ce592bc3cf5, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:05.644760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603d2b8-8c31-472f-9128-12af8ac7b129 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:05.666058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 957/1903] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:05 2022] PUT /identity/v3/projects/176025eef5a54930a9b334699c6342b8/users/f7b69a952f024ad5bbc17ce592bc3cf5/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:05.677645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7ee83-334f-40d0-9ba5-05848c4995a6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.677933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7ee83-334f-40d0-9ba5-05848c4995a6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.678265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7ee83-334f-40d0-9ba5-05848c4995a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.693769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef2f2c1955349feb33d93e00bedbdac'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.709984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-03a7ee83-334f-40d0-9ba5-05848c4995a6 None None] MFA Rules not processed for user `f7b69a952f024ad5bbc17ce592bc3cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:05.712241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-03a7ee83-334f-40d0-9ba5-05848c4995a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:05.712394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef2f2c1955349feb33d93e00bedbdac'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.712951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef2f2c1955349feb33d93e00bedbdac'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.713820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef2f2c1955349feb33d93e00bedbdac'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.721188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef2f2c1955349feb33d93e00bedbdac'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:05.735762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 947/1904] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:05 2022] DELETE /identity/v3/users/5ef2f2c1955349feb33d93e00bedbdac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:05.787419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 958/1905] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:05.792798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:05.794532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:05.862560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f425-0c37-431d-8452-74a0284f81b0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:05.867404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041a1b0-25dd-4a47-bcbf-7c9813143cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:05.868104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041a1b0-25dd-4a47-bcbf-7c9813143cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:05.868393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041a1b0-25dd-4a47-bcbf-7c9813143cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:05.868652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041a1b0-25dd-4a47-bcbf-7c9813143cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:05.869328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041a1b0-25dd-4a47-bcbf-7c9813143cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:05.871337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041a1b0-25dd-4a47-bcbf-7c9813143cb5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:05.906516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 948/1906] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:05 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:05.907618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7ee83-334f-40d0-9ba5-05848c4995a6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:05.978366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7ee83-334f-40d0-9ba5-05848c4995a6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.044420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041a1b0-25dd-4a47-bcbf-7c9813143cb5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.046373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b041a1b0-25dd-4a47-bcbf-7c9813143cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:06.063722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48ff5a-cb03-4025-a527-62923bac8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.064419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ff5a-cb03-4025-a527-62923bac8b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.064705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ff5a-cb03-4025-a527-62923bac8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.064980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ff5a-cb03-4025-a527-62923bac8b84 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.065674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48ff5a-cb03-4025-a527-62923bac8b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.067772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48ff5a-cb03-4025-a527-62923bac8b84 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.099677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 959/1907] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:05 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:06.103722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48ff5a-cb03-4025-a527-62923bac8b84 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.115420 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48ff5a-cb03-4025-a527-62923bac8b84 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.120405 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ce3b7-bce7-40d7-b352-950e9cad5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.121270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ce3b7-bce7-40d7-b352-950e9cad5593 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.121701 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ce3b7-bce7-40d7-b352-950e9cad5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.122155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ce3b7-bce7-40d7-b352-950e9cad5593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.123035 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ce3b7-bce7-40d7-b352-950e9cad5593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.125600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ce3b7-bce7-40d7-b352-950e9cad5593 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.132192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041a1b0-25dd-4a47-bcbf-7c9813143cb5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.136733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 960/1908] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:06.138364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.139423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.139703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.139977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] PATH_INFO: `/v3/projects/0e2109de1dad4661977e967a9c8259de` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.140988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ce3b7-bce7-40d7-b352-950e9cad5593 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.145853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2109de1dad4661977e967a9c8259de)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.147796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.158759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ce3b7-bce7-40d7-b352-950e9cad5593 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.163715 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a800-3c6e-4693-8ddf-0dca32c3e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.164618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a800-3c6e-4693-8ddf-0dca32c3e402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.165611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a800-3c6e-4693-8ddf-0dca32c3e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.165898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a800-3c6e-4693-8ddf-0dca32c3e402 admin admin] PATH_INFO: `/v3/projects/168a2c37beb1481e8a135bae30faff15/users/269a0d25de2c4a56ae143aaba0d4a2fa/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.182710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a800-3c6e-4693-8ddf-0dca32c3e402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168a2c37beb1481e8a135bae30faff15, user_id=269a0d25de2c4a56ae143aaba0d4a2fa, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.185353 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a800-3c6e-4693-8ddf-0dca32c3e402 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.201748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2109de1dad4661977e967a9c8259de', 'request_id': 'req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:06.201938 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 961/1909] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:06 2022] PUT /identity/v3/projects/168a2c37beb1481e8a135bae30faff15/users/269a0d25de2c4a56ae143aaba0d4a2fa/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:06.202661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a800-3c6e-4693-8ddf-0dca32c3e402 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.208464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2109de1dad4661977e967a9c8259de', 'request_id': 'req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:06.218344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2109de1dad4661977e967a9c8259de', 'request_id': 'req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:06.239788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] The token cache is being invalidate because project 0e2109de1dad4661977e967a9c8259de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:06.240092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:06.240814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4217de78-5978-4fb3-b314-6fbe1f5d7a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:06.243032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 949/1910] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:06 2022] DELETE /identity/v3/projects/0e2109de1dad4661977e967a9c8259de => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:06.248327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6a450-eb8c-49ee-985a-1f6014ad9d6d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.248612 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6a450-eb8c-49ee-985a-1f6014ad9d6d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.248885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6a450-eb8c-49ee-985a-1f6014ad9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.267633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-22b6a450-eb8c-49ee-985a-1f6014ad9d6d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:06.268822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-22b6a450-eb8c-49ee-985a-1f6014ad9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:06.277090 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a800-3c6e-4693-8ddf-0dca32c3e402 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.282169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b92c3-59a8-45f7-857d-3f0acd17e634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.283174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b92c3-59a8-45f7-857d-3f0acd17e634 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.283640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b92c3-59a8-45f7-857d-3f0acd17e634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.283914 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b92c3-59a8-45f7-857d-3f0acd17e634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.284688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b92c3-59a8-45f7-857d-3f0acd17e634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.285028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 950/1911] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:06.286706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152ec4c-488a-4d65-8788-119fbb8ca27a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.287506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152ec4c-488a-4d65-8788-119fbb8ca27a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.287792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152ec4c-488a-4d65-8788-119fbb8ca27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.287992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b92c3-59a8-45f7-857d-3f0acd17e634 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.300155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 962/1912] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:06.303900 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b92c3-59a8-45f7-857d-3f0acd17e634 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.305745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b43b92c3-59a8-45f7-857d-3f0acd17e634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:06.319060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2152ec4c-488a-4d65-8788-119fbb8ca27a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:06.320503 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2152ec4c-488a-4d65-8788-119fbb8ca27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:06.325349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b92c3-59a8-45f7-857d-3f0acd17e634 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.330690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8448e5-3dd0-4fef-ad8b-3d15ff99ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.331583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8448e5-3dd0-4fef-ad8b-3d15ff99ce37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.331881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8448e5-3dd0-4fef-ad8b-3d15ff99ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.332136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8448e5-3dd0-4fef-ad8b-3d15ff99ce37 admin admin] PATH_INFO: `/v3/projects/168a2c37beb1481e8a135bae30faff15/users/269a0d25de2c4a56ae143aaba0d4a2fa/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.338602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8448e5-3dd0-4fef-ad8b-3d15ff99ce37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168a2c37beb1481e8a135bae30faff15, user_id=269a0d25de2c4a56ae143aaba0d4a2fa, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.342032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8448e5-3dd0-4fef-ad8b-3d15ff99ce37 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.344683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 951/1913] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:06.348810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152ec4c-488a-4d65-8788-119fbb8ca27a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.353839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 963/1914] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:06 2022] PUT /identity/v3/projects/168a2c37beb1481e8a135bae30faff15/users/269a0d25de2c4a56ae143aaba0d4a2fa/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:06.364138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152ec4c-488a-4d65-8788-119fbb8ca27a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.365270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0813af-d2ce-4e5a-bb85-e4f7b8bf14c9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.365270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0813af-d2ce-4e5a-bb85-e4f7b8bf14c9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.365270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0813af-d2ce-4e5a-bb85-e4f7b8bf14c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.395294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5d0813af-d2ce-4e5a-bb85-e4f7b8bf14c9 None None] MFA Rules not processed for user `269a0d25de2c4a56ae143aaba0d4a2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:06.397351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5d0813af-d2ce-4e5a-bb85-e4f7b8bf14c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:06.427873 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc15337-1434-4285-af17-d8f47fc68000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.428533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc15337-1434-4285-af17-d8f47fc68000 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.428966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc15337-1434-4285-af17-d8f47fc68000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.429257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc15337-1434-4285-af17-d8f47fc68000 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.429991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc15337-1434-4285-af17-d8f47fc68000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:06.430885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc15337-1434-4285-af17-d8f47fc68000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.432483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc15337-1434-4285-af17-d8f47fc68000 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.451431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 952/1915] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:43:06.457792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc15337-1434-4285-af17-d8f47fc68000 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.467733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc15337-1434-4285-af17-d8f47fc68000 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.478142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554fddf-29f6-4648-8995-2eb65a496f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.479108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554fddf-29f6-4648-8995-2eb65a496f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.479405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554fddf-29f6-4648-8995-2eb65a496f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.479695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554fddf-29f6-4648-8995-2eb65a496f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.480385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554fddf-29f6-4648-8995-2eb65a496f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.482329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554fddf-29f6-4648-8995-2eb65a496f5c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.484539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 964/1916] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:06.496805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0813af-d2ce-4e5a-bb85-e4f7b8bf14c9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.498696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5d0813af-d2ce-4e5a-bb85-e4f7b8bf14c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:06.514092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 953/1917] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:06 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:06.517976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554fddf-29f6-4648-8995-2eb65a496f5c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.566256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0813af-d2ce-4e5a-bb85-e4f7b8bf14c9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.585552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554fddf-29f6-4648-8995-2eb65a496f5c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.591456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c8ad2-8a77-4131-9cf9-741aaed1d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.592203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c8ad2-8a77-4131-9cf9-741aaed1d38b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.592495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c8ad2-8a77-4131-9cf9-741aaed1d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.592775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c8ad2-8a77-4131-9cf9-741aaed1d38b admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.593625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c8ad2-8a77-4131-9cf9-741aaed1d38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.599787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c8ad2-8a77-4131-9cf9-741aaed1d38b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.622741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c0ca2-3a23-490d-b5c1-b8c974fcbb46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.623522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0ca2-3a23-490d-b5c1-b8c974fcbb46 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.624001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0ca2-3a23-490d-b5c1-b8c974fcbb46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.624338 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0ca2-3a23-490d-b5c1-b8c974fcbb46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.625484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 954/1918] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:06 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:06.626227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c8ad2-8a77-4131-9cf9-741aaed1d38b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.626992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0b0c0ca2-3a23-490d-b5c1-b8c974fcbb46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:06.636237 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c8ad2-8a77-4131-9cf9-741aaed1d38b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.641544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d4114-32c3-4f66-b8c9-8d8a40a68c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.642330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d4114-32c3-4f66-b8c9-8d8a40a68c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.642551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d4114-32c3-4f66-b8c9-8d8a40a68c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.642787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d4114-32c3-4f66-b8c9-8d8a40a68c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.643668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d4114-32c3-4f66-b8c9-8d8a40a68c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.645627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d4114-32c3-4f66-b8c9-8d8a40a68c68 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.656947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 955/1919] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:06.660786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d4114-32c3-4f66-b8c9-8d8a40a68c68 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.671333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d4114-32c3-4f66-b8c9-8d8a40a68c68 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.676431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42a181-5809-4fdd-a324-cf4ae2763090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.677101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42a181-5809-4fdd-a324-cf4ae2763090 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.677386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42a181-5809-4fdd-a324-cf4ae2763090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.677669 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42a181-5809-4fdd-a324-cf4ae2763090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.680343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42a181-5809-4fdd-a324-cf4ae2763090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.682082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42a181-5809-4fdd-a324-cf4ae2763090 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.692015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c0ca2-3a23-490d-b5c1-b8c974fcbb46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.693552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c0ca2-3a23-490d-b5c1-b8c974fcbb46 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.697256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 956/1920] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:06.698144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42a181-5809-4fdd-a324-cf4ae2763090 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.704076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 965/1921] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:06.708876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42a181-5809-4fdd-a324-cf4ae2763090 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.714842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ef0d7-a44d-4dd1-ac6c-652a6ffdde3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.715967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ef0d7-a44d-4dd1-ac6c-652a6ffdde3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.716280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ef0d7-a44d-4dd1-ac6c-652a6ffdde3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.716613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ef0d7-a44d-4dd1-ac6c-652a6ffdde3f admin admin] PATH_INFO: `/v3/projects/739e72ffc1194e50adaf59f2ba00b7f4/users/ef8b824f373741eda1b6031ef7557093/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.733019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ef0d7-a44d-4dd1-ac6c-652a6ffdde3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=739e72ffc1194e50adaf59f2ba00b7f4, user_id=ef8b824f373741eda1b6031ef7557093, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.735869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ef0d7-a44d-4dd1-ac6c-652a6ffdde3f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:06.752480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 957/1922] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:06 2022] PUT /identity/v3/projects/739e72ffc1194e50adaf59f2ba00b7f4/users/ef8b824f373741eda1b6031ef7557093/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:06.764346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e31a2-7f85-4824-9e8f-c997d45d1b32 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.764651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e31a2-7f85-4824-9e8f-c997d45d1b32 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.764938 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e31a2-7f85-4824-9e8f-c997d45d1b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.794193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-971e31a2-7f85-4824-9e8f-c997d45d1b32 None None] MFA Rules not processed for user `ef8b824f373741eda1b6031ef7557093`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:06.795617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-971e31a2-7f85-4824-9e8f-c997d45d1b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:06.890320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 966/1923] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:06.894294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ef0d7-a44d-4dd1-ac6c-652a6ffdde3f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:06.961293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ef0d7-a44d-4dd1-ac6c-652a6ffdde3f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:06.966864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59232bf8-ecf4-4fd8-9ab3-fc3fc9e96661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:06.967522 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59232bf8-ecf4-4fd8-9ab3-fc3fc9e96661 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:06.967807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59232bf8-ecf4-4fd8-9ab3-fc3fc9e96661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:06.968084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59232bf8-ecf4-4fd8-9ab3-fc3fc9e96661 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:06.968860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59232bf8-ecf4-4fd8-9ab3-fc3fc9e96661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:06.970933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59232bf8-ecf4-4fd8-9ab3-fc3fc9e96661 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:07.001337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 958/1924] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:06 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:07.006406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e31a2-7f85-4824-9e8f-c997d45d1b32 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:07.018836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e31a2-7f85-4824-9e8f-c997d45d1b32 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:07.092458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08434d39-05e1-47e0-aac8-9b7c1ea18b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:07.093810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08434d39-05e1-47e0-aac8-9b7c1ea18b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:07.094358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08434d39-05e1-47e0-aac8-9b7c1ea18b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:07.095130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08434d39-05e1-47e0-aac8-9b7c1ea18b8a admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:07.096072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08434d39-05e1-47e0-aac8-9b7c1ea18b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:07.099372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08434d39-05e1-47e0-aac8-9b7c1ea18b8a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:07.123157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 967/1925] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:07 2022] POST /identity/v3/users => generated 301 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:07.127539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59232bf8-ecf4-4fd8-9ab3-fc3fc9e96661 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:07.143036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59232bf8-ecf4-4fd8-9ab3-fc3fc9e96661 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:07.147994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a8311-bdb7-484c-a4b6-885587ddff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:07.149956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8311-bdb7-484c-a4b6-885587ddff70 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:07.150350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8311-bdb7-484c-a4b6-885587ddff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:07.150693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8311-bdb7-484c-a4b6-885587ddff70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:07.151629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a8311-bdb7-484c-a4b6-885587ddff70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:07.153347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a8311-bdb7-484c-a4b6-885587ddff70 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:07.166095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 959/1926] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:07.168979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08434d39-05e1-47e0-aac8-9b7c1ea18b8a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:07.181244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08434d39-05e1-47e0-aac8-9b7c1ea18b8a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:07.186069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93350b-7ce8-4243-a18b-ae346571c495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:07.187017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93350b-7ce8-4243-a18b-ae346571c495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:07.187492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93350b-7ce8-4243-a18b-ae346571c495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:07.187757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93350b-7ce8-4243-a18b-ae346571c495 admin admin] PATH_INFO: `/v3/projects/9b40d16b786a4cfcb667026ad1d38214/users/140d5e14b1fa4df8be5ff5c27c9032a4/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:07.203423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93350b-7ce8-4243-a18b-ae346571c495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b40d16b786a4cfcb667026ad1d38214, user_id=140d5e14b1fa4df8be5ff5c27c9032a4, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:07.206088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93350b-7ce8-4243-a18b-ae346571c495 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:07.220197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 968/1927] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:07 2022] PUT /identity/v3/projects/9b40d16b786a4cfcb667026ad1d38214/users/140d5e14b1fa4df8be5ff5c27c9032a4/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:07.224069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a8311-bdb7-484c-a4b6-885587ddff70 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:07.234707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a8311-bdb7-484c-a4b6-885587ddff70 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:07.304982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bab6e-d4a6-4140-b317-b30a675d5d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:07.306244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bab6e-d4a6-4140-b317-b30a675d5d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:07.306556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bab6e-d4a6-4140-b317-b30a675d5d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:07.306826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bab6e-d4a6-4140-b317-b30a675d5d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:07.307537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bab6e-d4a6-4140-b317-b30a675d5d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:07.309131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bab6e-d4a6-4140-b317-b30a675d5d5f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:07.319841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 960/1928] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:07.324278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93350b-7ce8-4243-a18b-ae346571c495 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:07.335861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93350b-7ce8-4243-a18b-ae346571c495 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:07.342628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031a440-047c-407a-bc56-f592c73947b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:07.344009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031a440-047c-407a-bc56-f592c73947b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:07.344575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031a440-047c-407a-bc56-f592c73947b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:07.345028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031a440-047c-407a-bc56-f592c73947b1 admin admin] PATH_INFO: `/v3/projects/9b40d16b786a4cfcb667026ad1d38214/users/140d5e14b1fa4df8be5ff5c27c9032a4/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:07.347259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031a440-047c-407a-bc56-f592c73947b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b40d16b786a4cfcb667026ad1d38214, user_id=140d5e14b1fa4df8be5ff5c27c9032a4, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:07.349991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031a440-047c-407a-bc56-f592c73947b1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:07.361217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 969/1929] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:07 2022] PUT /identity/v3/projects/9b40d16b786a4cfcb667026ad1d38214/users/140d5e14b1fa4df8be5ff5c27c9032a4/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:07.371601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8aea-9599-4b5b-9d9c-594d9dad0959 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:07.372040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8aea-9599-4b5b-9d9c-594d9dad0959 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:07.372446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8aea-9599-4b5b-9d9c-594d9dad0959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:07.399488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-720a8aea-9599-4b5b-9d9c-594d9dad0959 None None] MFA Rules not processed for user `140d5e14b1fa4df8be5ff5c27c9032a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:07.400706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-720a8aea-9599-4b5b-9d9c-594d9dad0959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:07.487206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 961/1930] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:07.500064 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031a440-047c-407a-bc56-f592c73947b1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:07.567426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031a440-047c-407a-bc56-f592c73947b1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:07.572317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71bd0e-bae0-488b-9de6-980274e2c2c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:07.573740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71bd0e-bae0-488b-9de6-980274e2c2c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:07.574282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71bd0e-bae0-488b-9de6-980274e2c2c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:07.574684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71bd0e-bae0-488b-9de6-980274e2c2c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:07.585992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71bd0e-bae0-488b-9de6-980274e2c2c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:07.588152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71bd0e-bae0-488b-9de6-980274e2c2c0 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:07.598406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 970/1931] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:07.736853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a8aea-9599-4b5b-9d9c-594d9dad0959 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:07.811027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a8aea-9599-4b5b-9d9c-594d9dad0959 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:07.815629 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:07.816493 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:07.816766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:07.817034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] PATH_INFO: `/v3/users/ef8b824f373741eda1b6031ef7557093` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:07.818241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8b824f373741eda1b6031ef7557093)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:07.820139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:07.865083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8b824f373741eda1b6031ef7557093'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:07.877969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8b824f373741eda1b6031ef7557093'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:07.878708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8b824f373741eda1b6031ef7557093'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:07.879313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8b824f373741eda1b6031ef7557093'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:07.886763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8b824f373741eda1b6031ef7557093'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:07.903627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 962/1932] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:07 2022] DELETE /identity/v3/users/ef8b824f373741eda1b6031ef7557093 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:07.909286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680c8f-ee19-4998-a70f-2bb24d517c6a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:07.910450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680c8f-ee19-4998-a70f-2bb24d517c6a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:07.910740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680c8f-ee19-4998-a70f-2bb24d517c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:07.935319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c1680c8f-ee19-4998-a70f-2bb24d517c6a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:07.935965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c1680c8f-ee19-4998-a70f-2bb24d517c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:08.002082 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:08.004019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:08.040551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 971/1933] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:08.050257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680c8f-ee19-4998-a70f-2bb24d517c6a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:08.051791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c1680c8f-ee19-4998-a70f-2bb24d517c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:08.095960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0e6d5-b335-4378-abb5-e95b904c452d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:08.114095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:08.115678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:08.116117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:08.116407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] PATH_INFO: `/v3/users/d2ca95f4eee44b81b58343a150357432` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:08.119116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ca95f4eee44b81b58343a150357432)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:08.121827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:08.159865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680c8f-ee19-4998-a70f-2bb24d517c6a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:08.163931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b53a8-0cfe-437d-9db5-67414cda5882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:08.164732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b53a8-0cfe-437d-9db5-67414cda5882 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:08.165114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b53a8-0cfe-437d-9db5-67414cda5882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:08.165487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b53a8-0cfe-437d-9db5-67414cda5882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:08.176679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b53a8-0cfe-437d-9db5-67414cda5882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:08.178612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b53a8-0cfe-437d-9db5-67414cda5882 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:08.195320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 972/1934] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:08.199058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ca95f4eee44b81b58343a150357432'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.220766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ca95f4eee44b81b58343a150357432'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.221690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ca95f4eee44b81b58343a150357432'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.224593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ca95f4eee44b81b58343a150357432'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.243988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ca95f4eee44b81b58343a150357432'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.264655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 963/1935] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:08 2022] DELETE /identity/v3/users/d2ca95f4eee44b81b58343a150357432 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:08.366583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b53a8-0cfe-437d-9db5-67414cda5882 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:08.368862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b49b53a8-0cfe-437d-9db5-67414cda5882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:08.459264 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b53a8-0cfe-437d-9db5-67414cda5882 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:08.519533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:08.523013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:08.533237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:08.533776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:08.534253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:08.534669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:08.549067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:08.604825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a246dd-2a7e-463e-895a-fda2fc5eb8ab admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:08.610344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:08.613287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:08.613287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:08.613287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] PATH_INFO: `/v3/projects/ca2444fc9d724881b212f4a9d24ca430` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:08.617838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2444fc9d724881b212f4a9d24ca430)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:08.620697 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:08.652861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:08.652861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:08.663694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 973/1936] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:08.689337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:08.691324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:08.705421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2444fc9d724881b212f4a9d24ca430', 'request_id': 'req-d0cc0eca-e52f-4842-9f64-668f015dc6ed'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.713436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2444fc9d724881b212f4a9d24ca430', 'request_id': 'req-d0cc0eca-e52f-4842-9f64-668f015dc6ed'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.723121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2444fc9d724881b212f4a9d24ca430', 'request_id': 'req-d0cc0eca-e52f-4842-9f64-668f015dc6ed'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.723556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bbead-7ee3-4124-8653-a0359b39a54f service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:08.772064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] The token cache is being invalidate because project ca2444fc9d724881b212f4a9d24ca430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:08.773529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.774471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.776363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 964/1937] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:08 2022] DELETE /identity/v3/projects/ca2444fc9d724881b212f4a9d24ca430 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:08.781836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:08.784753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:08.842358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:08.843354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:08.843738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:08.844266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] PATH_INFO: `/v3/projects/739e72ffc1194e50adaf59f2ba00b7f4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:08.845612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=739e72ffc1194e50adaf59f2ba00b7f4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:08.847836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:08.907777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739e72ffc1194e50adaf59f2ba00b7f4', 'request_id': 'req-98166b11-7869-4a44-9651-b4a6d6e57ceb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.911039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc0eca-e52f-4842-9f64-668f015dc6ed admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:08.916091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739e72ffc1194e50adaf59f2ba00b7f4', 'request_id': 'req-98166b11-7869-4a44-9651-b4a6d6e57ceb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.925312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739e72ffc1194e50adaf59f2ba00b7f4', 'request_id': 'req-98166b11-7869-4a44-9651-b4a6d6e57ceb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.945187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] The token cache is being invalidate because project 739e72ffc1194e50adaf59f2ba00b7f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:08.947035 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.948636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:08.952707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 974/1938] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:08 2022] DELETE /identity/v3/projects/739e72ffc1194e50adaf59f2ba00b7f4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:08.956205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:08.965139 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:09.015114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.015917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.016194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.016461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] PATH_INFO: `/v3/users/f4638689583f4b059f584893eb1ccd84` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.017720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4638689583f4b059f584893eb1ccd84)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.019684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.070689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98166b11-7869-4a44-9651-b4a6d6e57ceb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.076180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.077190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.077688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.078062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] PATH_INFO: `/v3/users/140d5e14b1fa4df8be5ff5c27c9032a4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.079545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140d5e14b1fa4df8be5ff5c27c9032a4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.081792 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.098565 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4638689583f4b059f584893eb1ccd84'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.111623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4638689583f4b059f584893eb1ccd84'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.112421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4638689583f4b059f584893eb1ccd84'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.113118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4638689583f4b059f584893eb1ccd84'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.120537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4638689583f4b059f584893eb1ccd84'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.130044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140d5e14b1fa4df8be5ff5c27c9032a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.133482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 965/1939] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:08 2022] DELETE /identity/v3/users/f4638689583f4b059f584893eb1ccd84 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:09.142515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140d5e14b1fa4df8be5ff5c27c9032a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.143271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140d5e14b1fa4df8be5ff5c27c9032a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.150186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140d5e14b1fa4df8be5ff5c27c9032a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.159365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140d5e14b1fa4df8be5ff5c27c9032a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.166342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 975/1940] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:08 2022] DELETE /identity/v3/users/140d5e14b1fa4df8be5ff5c27c9032a4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:09.307823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.309508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:09.392639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aad9c-053f-495a-94d1-c1b0449fd028 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.447975 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.450673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:09.453337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.455242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.455534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.455812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] PATH_INFO: `/v3/projects/ce75b97c54f34e4a9db8b69776d135c2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.457246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce75b97c54f34e4a9db8b69776d135c2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.459321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.466329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81bf6-a494-4f83-a86c-bb661a91da58 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.472321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.481561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.481862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.482168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] PATH_INFO: `/v3/projects/9b40d16b786a4cfcb667026ad1d38214` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.487164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b40d16b786a4cfcb667026ad1d38214)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.487410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.508695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce75b97c54f34e4a9db8b69776d135c2', 'request_id': 'req-35330831-81ea-43b2-9ac4-ca2b8bb0445d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.514555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce75b97c54f34e4a9db8b69776d135c2', 'request_id': 'req-35330831-81ea-43b2-9ac4-ca2b8bb0445d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.523038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce75b97c54f34e4a9db8b69776d135c2', 'request_id': 'req-35330831-81ea-43b2-9ac4-ca2b8bb0445d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.533799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] The token cache is being invalidate because project ce75b97c54f34e4a9db8b69776d135c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:09.533947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b40d16b786a4cfcb667026ad1d38214', 'request_id': 'req-64258e85-e4e6-4c86-89b0-54b012f68753'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.534448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.535197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35330831-81ea-43b2-9ac4-ca2b8bb0445d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.536744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 966/1941] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:09 2022] DELETE /identity/v3/projects/ce75b97c54f34e4a9db8b69776d135c2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:09.541555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b40d16b786a4cfcb667026ad1d38214', 'request_id': 'req-64258e85-e4e6-4c86-89b0-54b012f68753'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.543009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40faa1c-c8d0-4769-ba09-fbbe6be4725e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.543298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40faa1c-c8d0-4769-ba09-fbbe6be4725e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.543568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40faa1c-c8d0-4769-ba09-fbbe6be4725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.548597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b40d16b786a4cfcb667026ad1d38214', 'request_id': 'req-64258e85-e4e6-4c86-89b0-54b012f68753'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.559267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] The token cache is being invalidate because project 9b40d16b786a4cfcb667026ad1d38214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:09.559493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.560114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64258e85-e4e6-4c86-89b0-54b012f68753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:09.561270 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f40faa1c-c8d0-4769-ba09-fbbe6be4725e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:09.561656 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 976/1942] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:09 2022] DELETE /identity/v3/projects/9b40d16b786a4cfcb667026ad1d38214 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:09.565201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f40faa1c-c8d0-4769-ba09-fbbe6be4725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:09.566436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a249fa4-ff87-4de2-b916-597c238d219f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.566721 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a249fa4-ff87-4de2-b916-597c238d219f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.567001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a249fa4-ff87-4de2-b916-597c238d219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.584542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3a249fa4-ff87-4de2-b916-597c238d219f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:09.585938 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3a249fa4-ff87-4de2-b916-597c238d219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:09.619381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 967/1943] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:09.627201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabbf9-1fb6-4662-82db-e1ee8cb4c811 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.627478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabbf9-1fb6-4662-82db-e1ee8cb4c811 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.627761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabbf9-1fb6-4662-82db-e1ee8cb4c811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.643889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 977/1944] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:09.645098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e2dabbf9-1fb6-4662-82db-e1ee8cb4c811 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:09.646337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e2dabbf9-1fb6-4662-82db-e1ee8cb4c811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:09.651645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ffad4-10ab-4ac1-8bc5-fc2bb88fad9f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.651933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ffad4-10ab-4ac1-8bc5-fc2bb88fad9f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.652209 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ffad4-10ab-4ac1-8bc5-fc2bb88fad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.654833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 968/1945] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:09.658783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dabbf9-1fb6-4662-82db-e1ee8cb4c811 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.667709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dabbf9-1fb6-4662-82db-e1ee8cb4c811 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.670654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7f0ffad4-10ab-4ac1-8bc5-fc2bb88fad9f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:09.671873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f0ffad4-10ab-4ac1-8bc5-fc2bb88fad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:09.672311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0356a-d76c-4626-aaac-817d3d1ae7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.672952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0356a-d76c-4626-aaac-817d3d1ae7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.673230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0356a-d76c-4626-aaac-817d3d1ae7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.673505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0356a-d76c-4626-aaac-817d3d1ae7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.674256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0356a-d76c-4626-aaac-817d3d1ae7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:09.674560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0356a-d76c-4626-aaac-817d3d1ae7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.676137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0356a-d76c-4626-aaac-817d3d1ae7ff admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.680819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 978/1946] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:09.684686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ffad4-10ab-4ac1-8bc5-fc2bb88fad9f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.688407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 969/1947] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:43:09.692387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0356a-d76c-4626-aaac-817d3d1ae7ff admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.693504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ffad4-10ab-4ac1-8bc5-fc2bb88fad9f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.698811 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b0427-6530-43d5-b897-69e394e20cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.699497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b0427-6530-43d5-b897-69e394e20cab admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.699780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b0427-6530-43d5-b897-69e394e20cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.700151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b0427-6530-43d5-b897-69e394e20cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.701088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b0427-6530-43d5-b897-69e394e20cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:09.701670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b0427-6530-43d5-b897-69e394e20cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.703180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0356a-d76c-4626-aaac-817d3d1ae7ff admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.703748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b0427-6530-43d5-b897-69e394e20cab admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.708031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527ee3-ead4-4855-a32b-867b93ccb680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.708667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527ee3-ead4-4855-a32b-867b93ccb680 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.708953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527ee3-ead4-4855-a32b-867b93ccb680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.709228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527ee3-ead4-4855-a32b-867b93ccb680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.709900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66527ee3-ead4-4855-a32b-867b93ccb680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.712098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66527ee3-ead4-4855-a32b-867b93ccb680 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.719100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 979/1948] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:43:09.720001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b0427-6530-43d5-b897-69e394e20cab admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.731233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b0427-6530-43d5-b897-69e394e20cab admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.736601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7be7c3-751b-489a-ab98-b6bbe5f2c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.737199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7be7c3-751b-489a-ab98-b6bbe5f2c10c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.737479 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7be7c3-751b-489a-ab98-b6bbe5f2c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.737755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7be7c3-751b-489a-ab98-b6bbe5f2c10c admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.738494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7be7c3-751b-489a-ab98-b6bbe5f2c10c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.738609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 970/1949] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:09 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:09.740454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7be7c3-751b-489a-ab98-b6bbe5f2c10c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.742702 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527ee3-ead4-4855-a32b-867b93ccb680 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.771508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 980/1950] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:09 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:09.772437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7be7c3-751b-489a-ab98-b6bbe5f2c10c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.812465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527ee3-ead4-4855-a32b-867b93ccb680 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.835548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7be7c3-751b-489a-ab98-b6bbe5f2c10c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.841090 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b9d0f-d207-4b02-b1ff-594ca8d07c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.841764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9d0f-d207-4b02-b1ff-594ca8d07c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.842166 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9d0f-d207-4b02-b1ff-594ca8d07c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.842911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9d0f-d207-4b02-b1ff-594ca8d07c1a admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.843241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b9d0f-d207-4b02-b1ff-594ca8d07c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.845164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b9d0f-d207-4b02-b1ff-594ca8d07c1a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.868957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 981/1951] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:09 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:09.872508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b9d0f-d207-4b02-b1ff-594ca8d07c1a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.877428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e0b91-3ca8-4f58-af4a-e6f7f77b258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.882389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e0b91-3ca8-4f58-af4a-e6f7f77b258c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.882518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b9d0f-d207-4b02-b1ff-594ca8d07c1a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.882855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e0b91-3ca8-4f58-af4a-e6f7f77b258c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.883145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e0b91-3ca8-4f58-af4a-e6f7f77b258c admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.883915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e0b91-3ca8-4f58-af4a-e6f7f77b258c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.888013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e0b91-3ca8-4f58-af4a-e6f7f77b258c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.888297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8604864-3c2b-4c52-a63e-ccd93f274191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.889151 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8604864-3c2b-4c52-a63e-ccd93f274191 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.889588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8604864-3c2b-4c52-a63e-ccd93f274191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.889864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8604864-3c2b-4c52-a63e-ccd93f274191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.890702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8604864-3c2b-4c52-a63e-ccd93f274191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.892294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8604864-3c2b-4c52-a63e-ccd93f274191 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.905500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 982/1952] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:09.909249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8604864-3c2b-4c52-a63e-ccd93f274191 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.910791 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 971/1953] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:09 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:09.914969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e0b91-3ca8-4f58-af4a-e6f7f77b258c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.920526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8604864-3c2b-4c52-a63e-ccd93f274191 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.925166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e0b91-3ca8-4f58-af4a-e6f7f77b258c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.926028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d9634-293a-4d3c-831a-3c83d9d74029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.926689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d9634-293a-4d3c-831a-3c83d9d74029 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.926972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d9634-293a-4d3c-831a-3c83d9d74029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.927248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d9634-293a-4d3c-831a-3c83d9d74029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.928004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d9634-293a-4d3c-831a-3c83d9d74029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.929585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d9634-293a-4d3c-831a-3c83d9d74029 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.930989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a19b1-1d3d-4681-ba8a-2ce951051a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.931724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a19b1-1d3d-4681-ba8a-2ce951051a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.932078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a19b1-1d3d-4681-ba8a-2ce951051a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.932459 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a19b1-1d3d-4681-ba8a-2ce951051a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.933260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a19b1-1d3d-4681-ba8a-2ce951051a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.935094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a19b1-1d3d-4681-ba8a-2ce951051a12 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.941105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 983/1954] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:09.944933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d9634-293a-4d3c-831a-3c83d9d74029 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.946066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 972/1955] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:09.949566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a19b1-1d3d-4681-ba8a-2ce951051a12 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:09.955630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d9634-293a-4d3c-831a-3c83d9d74029 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.960523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93b6b1-0491-4daf-bada-f2e331f2a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.961259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a19b1-1d3d-4681-ba8a-2ce951051a12 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:09.962370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b6b1-0491-4daf-bada-f2e331f2a9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.962370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b6b1-0491-4daf-bada-f2e331f2a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.962370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b6b1-0491-4daf-bada-f2e331f2a9e8 admin admin] PATH_INFO: `/v3/projects/91a232e11d9049c9aa226fb7b2003100/users/e4ef33da64234e16bb7eb675ac36377e/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.968308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab08cc9-2dd6-4376-a9d3-38ba55be960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:09.968868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab08cc9-2dd6-4376-a9d3-38ba55be960d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:09.969152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab08cc9-2dd6-4376-a9d3-38ba55be960d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:09.969437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab08cc9-2dd6-4376-a9d3-38ba55be960d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:09.970382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab08cc9-2dd6-4376-a9d3-38ba55be960d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.971901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab08cc9-2dd6-4376-a9d3-38ba55be960d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.977984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93b6b1-0491-4daf-bada-f2e331f2a9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a232e11d9049c9aa226fb7b2003100, user_id=e4ef33da64234e16bb7eb675ac36377e, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:09.980802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93b6b1-0491-4daf-bada-f2e331f2a9e8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:09.985446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 973/1956] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:09.991821 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab08cc9-2dd6-4376-a9d3-38ba55be960d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.006829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab08cc9-2dd6-4376-a9d3-38ba55be960d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.016289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 984/1957] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:09 2022] PUT /identity/v3/projects/91a232e11d9049c9aa226fb7b2003100/users/e4ef33da64234e16bb7eb675ac36377e/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:10.028217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ad12-df5a-400e-abfa-cb352d263245 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.028717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ad12-df5a-400e-abfa-cb352d263245 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.028973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ad12-df5a-400e-abfa-cb352d263245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.060513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dba9ad12-df5a-400e-abfa-cb352d263245 None None] MFA Rules not processed for user `e4ef33da64234e16bb7eb675ac36377e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:10.061749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dba9ad12-df5a-400e-abfa-cb352d263245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:10.099147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d8e3a-64f4-48af-8d65-114f652a26b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.100654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d8e3a-64f4-48af-8d65-114f652a26b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.101440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d8e3a-64f4-48af-8d65-114f652a26b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.102124 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d8e3a-64f4-48af-8d65-114f652a26b8 admin admin] PATH_INFO: `/v3/projects/e02238c4cf7344978be7ca7c7c421001/users/6de080495ac84e6ba59b87fc4c77eeb4/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.123587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d8e3a-64f4-48af-8d65-114f652a26b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02238c4cf7344978be7ca7c7c421001, user_id=6de080495ac84e6ba59b87fc4c77eeb4, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.126394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d8e3a-64f4-48af-8d65-114f652a26b8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.147708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 974/1958] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:09 2022] PUT /identity/v3/projects/e02238c4cf7344978be7ca7c7c421001/users/6de080495ac84e6ba59b87fc4c77eeb4/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:10.153143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 985/1959] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:10.158938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d8e3a-64f4-48af-8d65-114f652a26b8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.161113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248523a4-4dcb-435f-aa37-52d0989a9feb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.161717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248523a4-4dcb-435f-aa37-52d0989a9feb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.162185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248523a4-4dcb-435f-aa37-52d0989a9feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.199779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-248523a4-4dcb-435f-aa37-52d0989a9feb None None] MFA Rules not processed for user `6de080495ac84e6ba59b87fc4c77eeb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:10.201053 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-248523a4-4dcb-435f-aa37-52d0989a9feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:10.253574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d8e3a-64f4-48af-8d65-114f652a26b8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.261307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0f267-bb19-4359-8576-8e69cfa760f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.262442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0f267-bb19-4359-8576-8e69cfa760f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.263117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0f267-bb19-4359-8576-8e69cfa760f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.263435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0f267-bb19-4359-8576-8e69cfa760f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.264324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0f267-bb19-4359-8576-8e69cfa760f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.267217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0f267-bb19-4359-8576-8e69cfa760f3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.297987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 986/1960] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:10.306748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 975/1961] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:10 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:10.311840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0f267-bb19-4359-8576-8e69cfa760f3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.312899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248523a4-4dcb-435f-aa37-52d0989a9feb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.315404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-40c0f267-bb19-4359-8576-8e69cfa760f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:10.324629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248523a4-4dcb-435f-aa37-52d0989a9feb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.387364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0f267-bb19-4359-8576-8e69cfa760f3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.391663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aa1c1-bc88-4323-a7b0-81d3045d4ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.392928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aa1c1-bc88-4323-a7b0-81d3045d4ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.393470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aa1c1-bc88-4323-a7b0-81d3045d4ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.393965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aa1c1-bc88-4323-a7b0-81d3045d4ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.410085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ed89-a19a-4e38-9573-cae7f4ddd7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.410913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ed89-a19a-4e38-9573-cae7f4ddd7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.411248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ed89-a19a-4e38-9573-cae7f4ddd7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.411469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ed89-a19a-4e38-9573-cae7f4ddd7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.412362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869ed89-a19a-4e38-9573-cae7f4ddd7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.414376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869ed89-a19a-4e38-9573-cae7f4ddd7b5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.443276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 987/1962] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:10 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:10.444322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ed89-a19a-4e38-9573-cae7f4ddd7b5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.454416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ed89-a19a-4e38-9573-cae7f4ddd7b5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.459648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cbdf-e6c2-40b3-8525-011fe9fca923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.460360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cbdf-e6c2-40b3-8525-011fe9fca923 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.460646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cbdf-e6c2-40b3-8525-011fe9fca923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.460983 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cbdf-e6c2-40b3-8525-011fe9fca923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.462202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7cbdf-e6c2-40b3-8525-011fe9fca923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.463784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7cbdf-e6c2-40b3-8525-011fe9fca923 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.468610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aa1c1-bc88-4323-a7b0-81d3045d4ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.470768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aa1c1-bc88-4323-a7b0-81d3045d4ca2 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.474480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 988/1963] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:10.479141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cbdf-e6c2-40b3-8525-011fe9fca923 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.485533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 976/1964] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:10.489434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cbdf-e6c2-40b3-8525-011fe9fca923 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.489860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aa1c1-bc88-4323-a7b0-81d3045d4ca2 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.491255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-122aa1c1-bc88-4323-a7b0-81d3045d4ca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:10.495193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caa199-7483-435e-93ee-f660d147b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.495885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caa199-7483-435e-93ee-f660d147b776 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.496187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caa199-7483-435e-93ee-f660d147b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.496442 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caa199-7483-435e-93ee-f660d147b776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.498065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caa199-7483-435e-93ee-f660d147b776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.499661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caa199-7483-435e-93ee-f660d147b776 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.503026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aa1c1-bc88-4323-a7b0-81d3045d4ca2 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.506823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14021b-2df0-46cd-8d10-e0f273db7e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.507472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14021b-2df0-46cd-8d10-e0f273db7e9a service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.507757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14021b-2df0-46cd-8d10-e0f273db7e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.508035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14021b-2df0-46cd-8d10-e0f273db7e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.510429 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2e14021b-2df0-46cd-8d10-e0f273db7e9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:10.512076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 989/1965] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:10.516356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caa199-7483-435e-93ee-f660d147b776 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.526661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caa199-7483-435e-93ee-f660d147b776 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.531306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2afc5-8ead-4f62-8472-8644acaa4dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.532884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2afc5-8ead-4f62-8472-8644acaa4dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.533169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2afc5-8ead-4f62-8472-8644acaa4dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.533449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2afc5-8ead-4f62-8472-8644acaa4dd0 admin admin] PATH_INFO: `/v3/projects/883636a226bc48378450e803a418aa8c/users/878025ccdf87451ea0ba3e2aaf2977b5/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.549524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2afc5-8ead-4f62-8472-8644acaa4dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883636a226bc48378450e803a418aa8c, user_id=878025ccdf87451ea0ba3e2aaf2977b5, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.552430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2afc5-8ead-4f62-8472-8644acaa4dd0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.566946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 990/1966] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:10 2022] PUT /identity/v3/projects/883636a226bc48378450e803a418aa8c/users/878025ccdf87451ea0ba3e2aaf2977b5/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:10.577694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef569a-517f-44c0-875e-27d3dbdbd8af None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.577944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef569a-517f-44c0-875e-27d3dbdbd8af None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.578259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef569a-517f-44c0-875e-27d3dbdbd8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.579031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14021b-2df0-46cd-8d10-e0f273db7e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.580580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14021b-2df0-46cd-8d10-e0f273db7e9a service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.591568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 977/1967] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:10.607212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e9ef569a-517f-44c0-875e-27d3dbdbd8af None None] MFA Rules not processed for user `878025ccdf87451ea0ba3e2aaf2977b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:10.608753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e9ef569a-517f-44c0-875e-27d3dbdbd8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:10.704299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 991/1968] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:10.709204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14021b-2df0-46cd-8d10-e0f273db7e9a service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.723335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14021b-2df0-46cd-8d10-e0f273db7e9a service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.782545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33679f-9d90-4a94-9522-83664a311152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.783295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33679f-9d90-4a94-9522-83664a311152 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.783666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33679f-9d90-4a94-9522-83664a311152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.784734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33679f-9d90-4a94-9522-83664a311152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.785535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33679f-9d90-4a94-9522-83664a311152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.787710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33679f-9d90-4a94-9522-83664a311152 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.813739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 978/1969] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:10 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:10.817078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef569a-517f-44c0-875e-27d3dbdbd8af None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.828119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef569a-517f-44c0-875e-27d3dbdbd8af None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.892695 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2ce44-afdb-4aa7-9be9-9f00909fce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.893532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2ce44-afdb-4aa7-9be9-9f00909fce88 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.893651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2ce44-afdb-4aa7-9be9-9f00909fce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.893956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2ce44-afdb-4aa7-9be9-9f00909fce88 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.894682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2ce44-afdb-4aa7-9be9-9f00909fce88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.896598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2ce44-afdb-4aa7-9be9-9f00909fce88 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.919362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 992/1970] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:10 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:10.923235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33679f-9d90-4a94-9522-83664a311152 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.935351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33679f-9d90-4a94-9522-83664a311152 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.940544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d2b81-5593-4265-abd8-181abdc58eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.941245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d2b81-5593-4265-abd8-181abdc58eec admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.941524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d2b81-5593-4265-abd8-181abdc58eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.941795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d2b81-5593-4265-abd8-181abdc58eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.942579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d2b81-5593-4265-abd8-181abdc58eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.944175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d2b81-5593-4265-abd8-181abdc58eec admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:10.955659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 979/1971] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:10.959922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2ce44-afdb-4aa7-9be9-9f00909fce88 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:10.970705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2ce44-afdb-4aa7-9be9-9f00909fce88 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:10.975514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6fde2-28fc-4015-be79-04982d598633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:10.976386 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6fde2-28fc-4015-be79-04982d598633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:10.976920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6fde2-28fc-4015-be79-04982d598633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:10.977222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6fde2-28fc-4015-be79-04982d598633 admin admin] PATH_INFO: `/v3/projects/df18964a8b31435eb8752f1a8b280dfd/users/a0c0b78dd1ff400eb43a85098487e831/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:10.994892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6fde2-28fc-4015-be79-04982d598633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df18964a8b31435eb8752f1a8b280dfd, user_id=a0c0b78dd1ff400eb43a85098487e831, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:10.997560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6fde2-28fc-4015-be79-04982d598633 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:11.010551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 993/1972] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:10 2022] PUT /identity/v3/projects/df18964a8b31435eb8752f1a8b280dfd/users/a0c0b78dd1ff400eb43a85098487e831/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:11.014454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d2b81-5593-4265-abd8-181abdc58eec admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:11.024792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d2b81-5593-4265-abd8-181abdc58eec admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:11.079918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69061eef-f8bc-49e0-b44d-252a362ce1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:11.080506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69061eef-f8bc-49e0-b44d-252a362ce1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:11.080786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69061eef-f8bc-49e0-b44d-252a362ce1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:11.081057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69061eef-f8bc-49e0-b44d-252a362ce1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:11.081781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69061eef-f8bc-49e0-b44d-252a362ce1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:11.083416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69061eef-f8bc-49e0-b44d-252a362ce1f8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:11.094502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 980/1973] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:11.098612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6fde2-28fc-4015-be79-04982d598633 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:11.109624 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6fde2-28fc-4015-be79-04982d598633 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:11.114358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4316f79-1e6a-4e04-a1ac-43bb635069ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:11.115240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316f79-1e6a-4e04-a1ac-43bb635069ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:11.115522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316f79-1e6a-4e04-a1ac-43bb635069ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:11.115795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316f79-1e6a-4e04-a1ac-43bb635069ad admin admin] PATH_INFO: `/v3/projects/df18964a8b31435eb8752f1a8b280dfd/users/a0c0b78dd1ff400eb43a85098487e831/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:11.118873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4316f79-1e6a-4e04-a1ac-43bb635069ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=df18964a8b31435eb8752f1a8b280dfd, user_id=a0c0b78dd1ff400eb43a85098487e831, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:11.121539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4316f79-1e6a-4e04-a1ac-43bb635069ad admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:11.132501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 994/1974] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:11 2022] PUT /identity/v3/projects/df18964a8b31435eb8752f1a8b280dfd/users/a0c0b78dd1ff400eb43a85098487e831/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:11.144127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb1bac-0d1c-4d6f-b70a-e91d83c97ec9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:11.144405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb1bac-0d1c-4d6f-b70a-e91d83c97ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:11.144785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb1bac-0d1c-4d6f-b70a-e91d83c97ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:11.171040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2bfb1bac-0d1c-4d6f-b70a-e91d83c97ec9 None None] MFA Rules not processed for user `a0c0b78dd1ff400eb43a85098487e831`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:11.172375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2bfb1bac-0d1c-4d6f-b70a-e91d83c97ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:11.245846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 981/1975] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:11.257581 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4316f79-1e6a-4e04-a1ac-43bb635069ad admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:11.311722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4316f79-1e6a-4e04-a1ac-43bb635069ad admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:11.315322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8099ba6-6c12-4e09-8b05-062348fa7d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:11.315953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8099ba6-6c12-4e09-8b05-062348fa7d70 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:11.316230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8099ba6-6c12-4e09-8b05-062348fa7d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:11.316499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8099ba6-6c12-4e09-8b05-062348fa7d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:11.325595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8099ba6-6c12-4e09-8b05-062348fa7d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:11.327041 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8099ba6-6c12-4e09-8b05-062348fa7d70 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:11.336057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 995/1976] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:11.380240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb1bac-0d1c-4d6f-b70a-e91d83c97ec9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:11.391968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb1bac-0d1c-4d6f-b70a-e91d83c97ec9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:11.395831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9e1bd-e0c1-4d0c-bee3-1b760a86d2c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:11.396518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9e1bd-e0c1-4d0c-bee3-1b760a86d2c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:11.396788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9e1bd-e0c1-4d0c-bee3-1b760a86d2c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:11.397071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9e1bd-e0c1-4d0c-bee3-1b760a86d2c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:11.454971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9e1bd-e0c1-4d0c-bee3-1b760a86d2c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:11.456401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9e1bd-e0c1-4d0c-bee3-1b760a86d2c2 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:11.466416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 982/1977] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:29.212910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8099ba6-6c12-4e09-8b05-062348fa7d70 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:29.318969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8099ba6-6c12-4e09-8b05-062348fa7d70 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:29.323585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:29.324482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:29.324763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:29.325047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] PATH_INFO: `/v3/users/e4ef33da64234e16bb7eb675ac36377e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:29.326609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ef33da64234e16bb7eb675ac36377e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:29.328545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:29.394307 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ef33da64234e16bb7eb675ac36377e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.412460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ef33da64234e16bb7eb675ac36377e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.413371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ef33da64234e16bb7eb675ac36377e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.424202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ef33da64234e16bb7eb675ac36377e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.432010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ef33da64234e16bb7eb675ac36377e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.438752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 996/1978] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:29 2022] DELETE /identity/v3/users/e4ef33da64234e16bb7eb675ac36377e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:29.443432 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5695f-8b5f-4243-ab2d-e1f49ba960f8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:29.444472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5695f-8b5f-4243-ab2d-e1f49ba960f8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:29.444963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5695f-8b5f-4243-ab2d-e1f49ba960f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:29.465831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:29.467353 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:29.468876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-48c5695f-8b5f-4243-ab2d-e1f49ba960f8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:29.470714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-48c5695f-8b5f-4243-ab2d-e1f49ba960f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:29.540007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bdf39-109d-42e2-9684-ef2811e72eea admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:29.544552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:29.545423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:29.545703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:29.545976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] PATH_INFO: `/v3/users/6de080495ac84e6ba59b87fc4c77eeb4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:29.546780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 983/1979] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:29.550776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de080495ac84e6ba59b87fc4c77eeb4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:29.552187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:29.557099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5695f-8b5f-4243-ab2d-e1f49ba960f8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:29.559063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-48c5695f-8b5f-4243-ab2d-e1f49ba960f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:29.614810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de080495ac84e6ba59b87fc4c77eeb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.633502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5695f-8b5f-4243-ab2d-e1f49ba960f8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:29.636769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de080495ac84e6ba59b87fc4c77eeb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.637539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de080495ac84e6ba59b87fc4c77eeb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.639435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de51f97-f27d-4529-8c22-5daa7baf5db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:29.640733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de51f97-f27d-4529-8c22-5daa7baf5db4 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:29.641081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de51f97-f27d-4529-8c22-5daa7baf5db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:29.641371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de51f97-f27d-4529-8c22-5daa7baf5db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:29.646052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de080495ac84e6ba59b87fc4c77eeb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.655072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de51f97-f27d-4529-8c22-5daa7baf5db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:29.656837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de51f97-f27d-4529-8c22-5daa7baf5db4 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:29.656949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de080495ac84e6ba59b87fc4c77eeb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:29.667743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 984/1980] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:29.668794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 997/1981] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:29 2022] DELETE /identity/v3/users/6de080495ac84e6ba59b87fc4c77eeb4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:29.676081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087527b4-152b-485e-8822-8de1bcbc71d6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:29.676380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087527b4-152b-485e-8822-8de1bcbc71d6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:29.676663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087527b4-152b-485e-8822-8de1bcbc71d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:29.705966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-087527b4-152b-485e-8822-8de1bcbc71d6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:29.709261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-087527b4-152b-485e-8822-8de1bcbc71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:29.785886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 985/1982] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:29.798628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:29.800607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:29.908882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5536b-7ca0-4aad-bb5d-90637fa7bb99 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:29.913005 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e938a-6746-4442-b1c8-fdfe6f5b2b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:29.913820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e938a-6746-4442-b1c8-fdfe6f5b2b6f service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:29.914170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e938a-6746-4442-b1c8-fdfe6f5b2b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:29.914446 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e938a-6746-4442-b1c8-fdfe6f5b2b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:29.925387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e938a-6746-4442-b1c8-fdfe6f5b2b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:29.927465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e938a-6746-4442-b1c8-fdfe6f5b2b6f service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:29.940743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 998/1983] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:30.051971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087527b4-152b-485e-8822-8de1bcbc71d6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:30.053634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-087527b4-152b-485e-8822-8de1bcbc71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:30.109518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087527b4-152b-485e-8822-8de1bcbc71d6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:30.120131 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:30.121309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:30.121720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:30.122687 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] PATH_INFO: `/v3/projects/91a232e11d9049c9aa226fb7b2003100` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:30.124139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a232e11d9049c9aa226fb7b2003100)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:30.126533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:30.218723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a232e11d9049c9aa226fb7b2003100', 'request_id': 'req-fddc5857-3687-4a28-bde5-31c0955f73e9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.238674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a232e11d9049c9aa226fb7b2003100', 'request_id': 'req-fddc5857-3687-4a28-bde5-31c0955f73e9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.256297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a232e11d9049c9aa226fb7b2003100', 'request_id': 'req-fddc5857-3687-4a28-bde5-31c0955f73e9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.269319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] The token cache is being invalidate because project 91a232e11d9049c9aa226fb7b2003100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:30.269720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.270711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.272555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 986/1984] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:30 2022] DELETE /identity/v3/projects/91a232e11d9049c9aa226fb7b2003100 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:30.276873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e938a-6746-4442-b1c8-fdfe6f5b2b6f service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:30.288220 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e938a-6746-4442-b1c8-fdfe6f5b2b6f service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:30.353362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:30.354823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:30.387553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:30.388050 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:30.388390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:30.388597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] PATH_INFO: `/v3/users/878025ccdf87451ea0ba3e2aaf2977b5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:30.390515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=878025ccdf87451ea0ba3e2aaf2977b5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:30.392476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:30.459382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878025ccdf87451ea0ba3e2aaf2977b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.487977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878025ccdf87451ea0ba3e2aaf2977b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.489221 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878025ccdf87451ea0ba3e2aaf2977b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.498974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc5857-3687-4a28-bde5-31c0955f73e9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:30.499527 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878025ccdf87451ea0ba3e2aaf2977b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.506385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:30.509049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:30.509513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:30.510024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] PATH_INFO: `/v3/projects/e02238c4cf7344978be7ca7c7c421001` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:30.510629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878025ccdf87451ea0ba3e2aaf2977b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.511948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02238c4cf7344978be7ca7c7c421001)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:30.514905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:30.519310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 999/1985] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:30 2022] DELETE /identity/v3/users/878025ccdf87451ea0ba3e2aaf2977b5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:30.614676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:30.616576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:30.635933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02238c4cf7344978be7ca7c7c421001', 'request_id': 'req-be96ae9c-88ed-4bdd-9236-9520978fd1aa'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.655628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02238c4cf7344978be7ca7c7c421001', 'request_id': 'req-be96ae9c-88ed-4bdd-9236-9520978fd1aa'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.683994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02238c4cf7344978be7ca7c7c421001', 'request_id': 'req-be96ae9c-88ed-4bdd-9236-9520978fd1aa'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.700360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] The token cache is being invalidate because project e02238c4cf7344978be7ca7c7c421001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:30.700747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.702275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-be96ae9c-88ed-4bdd-9236-9520978fd1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.705185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 987/1986] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:30 2022] DELETE /identity/v3/projects/e02238c4cf7344978be7ca7c7c421001 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:30.712136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee44e4-f88e-4bde-b46c-544cd7d1621e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:30.712492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee44e4-f88e-4bde-b46c-544cd7d1621e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:30.712806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee44e4-f88e-4bde-b46c-544cd7d1621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:30.741330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7ac60-670a-4635-80c2-e7ed685925bc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:30.755995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8bee44e4-f88e-4bde-b46c-544cd7d1621e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:30.757413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8bee44e4-f88e-4bde-b46c-544cd7d1621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:30.854680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:30.855962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:30.857046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:30.857691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] PATH_INFO: `/v3/users/0f800b151a354b1ea4fb0cf0a56d6d56` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:30.859497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f800b151a354b1ea4fb0cf0a56d6d56)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:30.859630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 988/1987] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:30.861168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529ca59-0282-42bd-9e91-7f74cbf497a1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:30.861452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529ca59-0282-42bd-9e91-7f74cbf497a1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:30.861729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529ca59-0282-42bd-9e91-7f74cbf497a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:30.862434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:30.885682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d529ca59-0282-42bd-9e91-7f74cbf497a1 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:30.887057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d529ca59-0282-42bd-9e91-7f74cbf497a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:30.901158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 989/1988] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:30.905635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529ca59-0282-42bd-9e91-7f74cbf497a1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:30.916543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529ca59-0282-42bd-9e91-7f74cbf497a1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:30.921421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1151826-9190-4831-8fa9-102ef8e3762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:30.922160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1151826-9190-4831-8fa9-102ef8e3762c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:30.922882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1151826-9190-4831-8fa9-102ef8e3762c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:30.922882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1151826-9190-4831-8fa9-102ef8e3762c admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:30.923427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1151826-9190-4831-8fa9-102ef8e3762c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:30.923738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1151826-9190-4831-8fa9-102ef8e3762c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:30.926906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1151826-9190-4831-8fa9-102ef8e3762c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:30.927047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f800b151a354b1ea4fb0cf0a56d6d56'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.940831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f800b151a354b1ea4fb0cf0a56d6d56'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.941884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f800b151a354b1ea4fb0cf0a56d6d56'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.954793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 990/1989] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:43:30.958229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f800b151a354b1ea4fb0cf0a56d6d56'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.960365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1151826-9190-4831-8fa9-102ef8e3762c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:30.969714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a9e967a-af1e-4d6d-bf12-604de6c991da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f800b151a354b1ea4fb0cf0a56d6d56'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:30.971741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1151826-9190-4831-8fa9-102ef8e3762c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:30.977122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd328748-3f0a-4225-a576-e9a345c5e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:30.977791 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd328748-3f0a-4225-a576-e9a345c5e985 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:30.978111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd328748-3f0a-4225-a576-e9a345c5e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:30.978391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd328748-3f0a-4225-a576-e9a345c5e985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:30.979069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd328748-3f0a-4225-a576-e9a345c5e985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:30.981588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1000/1990] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:30 2022] DELETE /identity/v3/users/0f800b151a354b1ea4fb0cf0a56d6d56 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:30.981731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd328748-3f0a-4225-a576-e9a345c5e985 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:30.986910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957e58b-8ce0-423d-923f-81a756c9c2d6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:30.987206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957e58b-8ce0-423d-923f-81a756c9c2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:30.987484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957e58b-8ce0-423d-923f-81a756c9c2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.011145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6957e58b-8ce0-423d-923f-81a756c9c2d6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:31.012361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6957e58b-8ce0-423d-923f-81a756c9c2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:31.018180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 991/1991] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:30 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:31.023080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd328748-3f0a-4225-a576-e9a345c5e985 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.034883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dd328748-3f0a-4225-a576-e9a345c5e985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:31.104158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1001/1992] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:31.107343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957e58b-8ce0-423d-923f-81a756c9c2d6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.107343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6957e58b-8ce0-423d-923f-81a756c9c2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:31.122937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957e58b-8ce0-423d-923f-81a756c9c2d6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:31.128119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:31.128994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:31.129279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:31.129557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] PATH_INFO: `/v3/projects/883636a226bc48378450e803a418aa8c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.130813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=883636a226bc48378450e803a418aa8c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:31.132158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd328748-3f0a-4225-a576-e9a345c5e985 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:31.132804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:31.138077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e52ae-cae5-49e3-ba3c-9c367b1db6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:31.138840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e52ae-cae5-49e3-ba3c-9c367b1db6ec admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:31.139198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e52ae-cae5-49e3-ba3c-9c367b1db6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:31.140034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e52ae-cae5-49e3-ba3c-9c367b1db6ec admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.142072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e52ae-cae5-49e3-ba3c-9c367b1db6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:31.146259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e52ae-cae5-49e3-ba3c-9c367b1db6ec admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:31.167151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 992/1993] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:31 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:31.168312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e52ae-cae5-49e3-ba3c-9c367b1db6ec admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.170229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dc7e52ae-cae5-49e3-ba3c-9c367b1db6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:31.198407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883636a226bc48378450e803a418aa8c', 'request_id': 'req-794a068a-67f6-461f-92fa-88ffc88395ae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.204669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883636a226bc48378450e803a418aa8c', 'request_id': 'req-794a068a-67f6-461f-92fa-88ffc88395ae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.214706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883636a226bc48378450e803a418aa8c', 'request_id': 'req-794a068a-67f6-461f-92fa-88ffc88395ae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.225467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] The token cache is being invalidate because project 883636a226bc48378450e803a418aa8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:31.225844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.226611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.230198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1002/1994] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:31 2022] DELETE /identity/v3/projects/883636a226bc48378450e803a418aa8c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:31.230198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.230642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:31.240544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e52ae-cae5-49e3-ba3c-9c367b1db6ec admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:31.309664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc1d92-b201-4cb5-b060-4e219b182910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:31.310342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1d92-b201-4cb5-b060-4e219b182910 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:31.310622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1d92-b201-4cb5-b060-4e219b182910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:31.311126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1d92-b201-4cb5-b060-4e219b182910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.312940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1bdc1d92-b201-4cb5-b060-4e219b182910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:31.324250 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a068a-67f6-461f-92fa-88ffc88395ae admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:31.338293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b309b4-442c-4c1a-a80a-c78ee0c10b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:31.339135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b309b4-442c-4c1a-a80a-c78ee0c10b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:31.339248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b309b4-442c-4c1a-a80a-c78ee0c10b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:31.339904 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b309b4-442c-4c1a-a80a-c78ee0c10b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.340252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b309b4-442c-4c1a-a80a-c78ee0c10b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:31.341868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b309b4-442c-4c1a-a80a-c78ee0c10b60 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:31.356572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc1d92-b201-4cb5-b060-4e219b182910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:31.358072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc1d92-b201-4cb5-b060-4e219b182910 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:31.368755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1003/1995] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:31.368755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b309b4-442c-4c1a-a80a-c78ee0c10b60 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.374677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-73b309b4-442c-4c1a-a80a-c78ee0c10b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:31.376698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 993/1996] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:31.377574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc1d92-b201-4cb5-b060-4e219b182910 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.395783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b309b4-442c-4c1a-a80a-c78ee0c10b60 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:31.400615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc1d92-b201-4cb5-b060-4e219b182910 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:31.407932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:31.408828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:31.409113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:31.409418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] PATH_INFO: `/v3/users/a0c0b78dd1ff400eb43a85098487e831` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.411308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c0b78dd1ff400eb43a85098487e831)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:31.413281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:31.415614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025a195-e374-4e2c-bf02-8c570593bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:31.416298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a195-e374-4e2c-bf02-8c570593bd39 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:31.416578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a195-e374-4e2c-bf02-8c570593bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:31.416852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a195-e374-4e2c-bf02-8c570593bd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.417636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025a195-e374-4e2c-bf02-8c570593bd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:31.420093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025a195-e374-4e2c-bf02-8c570593bd39 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:31.447438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 994/1997] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:31.449423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025a195-e374-4e2c-bf02-8c570593bd39 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.470104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025a195-e374-4e2c-bf02-8c570593bd39 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:31.493936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a01691-3387-4f50-8988-86624001faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:31.494865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a01691-3387-4f50-8988-86624001faca admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:31.495147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a01691-3387-4f50-8988-86624001faca admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:31.496509 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a01691-3387-4f50-8988-86624001faca admin admin] PATH_INFO: `/v3/projects/4fc392e2a19641828e5a51cf84f828c3/users/7f094b1223d44a66907a15a74691def9/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.515552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c0b78dd1ff400eb43a85098487e831'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.525018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a01691-3387-4f50-8988-86624001faca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc392e2a19641828e5a51cf84f828c3, user_id=7f094b1223d44a66907a15a74691def9, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:31.527973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a01691-3387-4f50-8988-86624001faca admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:31.540300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c0b78dd1ff400eb43a85098487e831'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.541069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c0b78dd1ff400eb43a85098487e831'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.553797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c0b78dd1ff400eb43a85098487e831'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.554223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 995/1998] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:31 2022] PUT /identity/v3/projects/4fc392e2a19641828e5a51cf84f828c3/users/7f094b1223d44a66907a15a74691def9/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:31.566368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f9c3-59cf-48ea-8287-e2265502ca01 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:31.566654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f9c3-59cf-48ea-8287-e2265502ca01 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:31.566937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f9c3-59cf-48ea-8287-e2265502ca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.567121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c0b78dd1ff400eb43a85098487e831'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:31.574617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1004/1999] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:31 2022] DELETE /identity/v3/users/a0c0b78dd1ff400eb43a85098487e831 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:31.615037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-06b3f9c3-59cf-48ea-8287-e2265502ca01 None None] MFA Rules not processed for user `7f094b1223d44a66907a15a74691def9`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:31.617728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-06b3f9c3-59cf-48ea-8287-e2265502ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:31.713408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 996/2000] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:31.713585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.715078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:31.849072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c3d3-f412-449b-94b2-b52d4902cc38 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:31.873186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf22c3-b7df-4b2e-9062-a2b37428daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:31.875536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf22c3-b7df-4b2e-9062-a2b37428daa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:31.875850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf22c3-b7df-4b2e-9062-a2b37428daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:31.876206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf22c3-b7df-4b2e-9062-a2b37428daa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:31.877127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf22c3-b7df-4b2e-9062-a2b37428daa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:31.880305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf22c3-b7df-4b2e-9062-a2b37428daa8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:31.938119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1005/2001] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:31 2022] POST /identity/v3/projects => generated 375 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:31.942564 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3f9c3-59cf-48ea-8287-e2265502ca01 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.958032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf22c3-b7df-4b2e-9062-a2b37428daa8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:31.959550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3f9c3-59cf-48ea-8287-e2265502ca01 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:31.962418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cabf22c3-b7df-4b2e-9062-a2b37428daa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.070830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf22c3-b7df-4b2e-9062-a2b37428daa8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.078720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.081486 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.082913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.084722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] PATH_INFO: `/v3/projects/847c2981691b48f18ae56c04afdf6cba` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.086898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847c2981691b48f18ae56c04afdf6cba)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.088994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.124311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af9052-13af-43b9-a254-4abb2d98fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.126026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af9052-13af-43b9-a254-4abb2d98fa84 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.126558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af9052-13af-43b9-a254-4abb2d98fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.127056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af9052-13af-43b9-a254-4abb2d98fa84 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.128846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af9052-13af-43b9-a254-4abb2d98fa84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.131228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af9052-13af-43b9-a254-4abb2d98fa84 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.158093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847c2981691b48f18ae56c04afdf6cba', 'request_id': 'req-0353de5a-2617-47f1-8c03-7693f014fdd7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.164757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 997/2002] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:31 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:32.165794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847c2981691b48f18ae56c04afdf6cba', 'request_id': 'req-0353de5a-2617-47f1-8c03-7693f014fdd7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.168090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af9052-13af-43b9-a254-4abb2d98fa84 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.178397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af9052-13af-43b9-a254-4abb2d98fa84 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.178994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847c2981691b48f18ae56c04afdf6cba', 'request_id': 'req-0353de5a-2617-47f1-8c03-7693f014fdd7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.193526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] The token cache is being invalidate because project 847c2981691b48f18ae56c04afdf6cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:32.194177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.196088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.201244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1006/2003] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:31 2022] DELETE /identity/v3/projects/847c2981691b48f18ae56c04afdf6cba => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:32.207887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.209461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.283841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b01952-84d2-4123-beef-0028d870048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.284789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b01952-84d2-4123-beef-0028d870048a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.284912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b01952-84d2-4123-beef-0028d870048a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.285260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b01952-84d2-4123-beef-0028d870048a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.286088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b01952-84d2-4123-beef-0028d870048a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.287982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b01952-84d2-4123-beef-0028d870048a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.301641 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 998/2004] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:32.306155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b01952-84d2-4123-beef-0028d870048a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.310631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-33b01952-84d2-4123-beef-0028d870048a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.310817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353de5a-2617-47f1-8c03-7693f014fdd7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.317409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.318509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.319191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.319636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] PATH_INFO: `/v3/users/f7b69a952f024ad5bbc17ce592bc3cf5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.321889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b69a952f024ad5bbc17ce592bc3cf5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.325450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.327467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b01952-84d2-4123-beef-0028d870048a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.333733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3292-c87b-4ce8-b38d-7e3f48880204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.334731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3292-c87b-4ce8-b38d-7e3f48880204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.335020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3292-c87b-4ce8-b38d-7e3f48880204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.335298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3292-c87b-4ce8-b38d-7e3f48880204 admin admin] PATH_INFO: `/v3/projects/be52cb6c4de54de898dc71586a8561bd/users/2085322b3bd94a949eb9c672e579f5d6/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.367825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e3292-c87b-4ce8-b38d-7e3f48880204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be52cb6c4de54de898dc71586a8561bd, user_id=2085322b3bd94a949eb9c672e579f5d6, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.371704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e3292-c87b-4ce8-b38d-7e3f48880204 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.388797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b69a952f024ad5bbc17ce592bc3cf5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.393070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 999/2005] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:32 2022] PUT /identity/v3/projects/be52cb6c4de54de898dc71586a8561bd/users/2085322b3bd94a949eb9c672e579f5d6/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:32.393741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3292-c87b-4ce8-b38d-7e3f48880204 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.397095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-766e3292-c87b-4ce8-b38d-7e3f48880204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.402569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b69a952f024ad5bbc17ce592bc3cf5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.404092 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b69a952f024ad5bbc17ce592bc3cf5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.411888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b69a952f024ad5bbc17ce592bc3cf5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.425189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b69a952f024ad5bbc17ce592bc3cf5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.445321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1007/2006] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:32 2022] DELETE /identity/v3/users/f7b69a952f024ad5bbc17ce592bc3cf5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:32.446371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.447951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.468597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3292-c87b-4ce8-b38d-7e3f48880204 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.529782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b17b5d-d804-4770-9e28-9090661e3ca7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.535996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.536900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.537177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.537452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] PATH_INFO: `/v3/projects/df18964a8b31435eb8752f1a8b280dfd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.539404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df18964a8b31435eb8752f1a8b280dfd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.541476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.545361 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1680-b2b8-4209-96cb-2ce4928b1b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.546068 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1680-b2b8-4209-96cb-2ce4928b1b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.546359 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1680-b2b8-4209-96cb-2ce4928b1b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.546636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1680-b2b8-4209-96cb-2ce4928b1b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.547406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b1680-b2b8-4209-96cb-2ce4928b1b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.549263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b1680-b2b8-4209-96cb-2ce4928b1b92 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.564802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1008/2007] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:32.565966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1680-b2b8-4209-96cb-2ce4928b1b92 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.578479 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1680-b2b8-4209-96cb-2ce4928b1b92 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.591463 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df18964a8b31435eb8752f1a8b280dfd', 'request_id': 'req-59c7aed9-cc4f-407e-974a-e008d26e39b5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.600726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df18964a8b31435eb8752f1a8b280dfd', 'request_id': 'req-59c7aed9-cc4f-407e-974a-e008d26e39b5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.616583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df18964a8b31435eb8752f1a8b280dfd', 'request_id': 'req-59c7aed9-cc4f-407e-974a-e008d26e39b5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.631301 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] The token cache is being invalidate because project df18964a8b31435eb8752f1a8b280dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:32.632428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.633375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-59c7aed9-cc4f-407e-974a-e008d26e39b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.640530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1000/2008] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:32 2022] DELETE /identity/v3/projects/df18964a8b31435eb8752f1a8b280dfd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:32.642240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99dd05-c418-449d-adac-52993e442302 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.642535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99dd05-c418-449d-adac-52993e442302 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.642835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99dd05-c418-449d-adac-52993e442302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.663182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f106906-e3ad-475f-9405-3a8d256f11e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.664144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f106906-e3ad-475f-9405-3a8d256f11e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.664728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f106906-e3ad-475f-9405-3a8d256f11e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.665269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f106906-e3ad-475f-9405-3a8d256f11e2 admin admin] PATH_INFO: `/v3/projects/be52cb6c4de54de898dc71586a8561bd/users/2085322b3bd94a949eb9c672e579f5d6/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.667393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f106906-e3ad-475f-9405-3a8d256f11e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be52cb6c4de54de898dc71586a8561bd, user_id=2085322b3bd94a949eb9c672e579f5d6, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.670104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f106906-e3ad-475f-9405-3a8d256f11e2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.672120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ba99dd05-c418-449d-adac-52993e442302 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:32.674523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ba99dd05-c418-449d-adac-52993e442302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.690142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1009/2009] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:32 2022] PUT /identity/v3/projects/be52cb6c4de54de898dc71586a8561bd/users/2085322b3bd94a949eb9c672e579f5d6/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:32.693705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f22c-8701-4470-90b7-c73f71f07a2c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.694043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f22c-8701-4470-90b7-c73f71f07a2c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.694350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f22c-8701-4470-90b7-c73f71f07a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.725379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-61e9f22c-8701-4470-90b7-c73f71f07a2c None None] MFA Rules not processed for user `2085322b3bd94a949eb9c672e579f5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:32.726928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-61e9f22c-8701-4470-90b7-c73f71f07a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.761101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1001/2010] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:32.770485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee02826-3c51-4f98-9403-39c04e54bfda None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.771056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee02826-3c51-4f98-9403-39c04e54bfda None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.771445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee02826-3c51-4f98-9403-39c04e54bfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.790360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-eee02826-3c51-4f98-9403-39c04e54bfda None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:32.791690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-eee02826-3c51-4f98-9403-39c04e54bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.801066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1002/2011] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:32.801891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee02826-3c51-4f98-9403-39c04e54bfda None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.803262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-eee02826-3c51-4f98-9403-39c04e54bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.813136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1010/2012] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:32.816820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f22c-8701-4470-90b7-c73f71f07a2c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.816932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee02826-3c51-4f98-9403-39c04e54bfda None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.822314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.823215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.823497 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.823771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] PATH_INFO: `/v3/projects/176025eef5a54930a9b334699c6342b8` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.824967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=176025eef5a54930a9b334699c6342b8)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.825705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f22c-8701-4470-90b7-c73f71f07a2c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.826940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.830471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.831021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.831299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.831568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.832290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:32.832591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.834208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:32.848902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1011/2013] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:43:32.848902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.848902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.876179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176025eef5a54930a9b334699c6342b8', 'request_id': 'req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.883236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176025eef5a54930a9b334699c6342b8', 'request_id': 'req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.890848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176025eef5a54930a9b334699c6342b8', 'request_id': 'req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.901198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] The token cache is being invalidate because project 176025eef5a54930a9b334699c6342b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:32.901961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.902212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:32.904037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1003/2014] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:32 2022] DELETE /identity/v3/projects/176025eef5a54930a9b334699c6342b8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:32.904565 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:32.906037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303dd6b-134a-4c03-9e95-fecac12030ea admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.906167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.955883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e462a16-23fa-4427-a2fe-3aaa29d43719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.956458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e462a16-23fa-4427-a2fe-3aaa29d43719 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.956739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e462a16-23fa-4427-a2fe-3aaa29d43719 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.957015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e462a16-23fa-4427-a2fe-3aaa29d43719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.958876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8e462a16-23fa-4427-a2fe-3aaa29d43719 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:32.970440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16499-31a6-4d22-89bb-1c4eec72ec7f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:32.975076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d341b2-e764-4382-883a-cb23068fb3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:32.975724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d341b2-e764-4382-883a-cb23068fb3cf admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:32.976005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d341b2-e764-4382-883a-cb23068fb3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:32.976326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d341b2-e764-4382-883a-cb23068fb3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:32.977317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d341b2-e764-4382-883a-cb23068fb3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:32.979272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d341b2-e764-4382-883a-cb23068fb3cf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.003975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1004/2015] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:32 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:33.004921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d341b2-e764-4382-883a-cb23068fb3cf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.006789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e0d341b2-e764-4382-883a-cb23068fb3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:33.019115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e462a16-23fa-4427-a2fe-3aaa29d43719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.020656 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e462a16-23fa-4427-a2fe-3aaa29d43719 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.030257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1012/2016] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:33.031127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e462a16-23fa-4427-a2fe-3aaa29d43719 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.042624 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e462a16-23fa-4427-a2fe-3aaa29d43719 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.075864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d341b2-e764-4382-883a-cb23068fb3cf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.080815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.081958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.082177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.082483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] PATH_INFO: `/v3/users/269a0d25de2c4a56ae143aaba0d4a2fa` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.083787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=269a0d25de2c4a56ae143aaba0d4a2fa)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.085954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.113909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e074-2de8-4809-895e-222a57e04977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.114531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e074-2de8-4809-895e-222a57e04977 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.114815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e074-2de8-4809-895e-222a57e04977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.115091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e074-2de8-4809-895e-222a57e04977 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.115879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9e074-2de8-4809-895e-222a57e04977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.117882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9e074-2de8-4809-895e-222a57e04977 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.143191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1013/2017] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:33 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:33.144426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e074-2de8-4809-895e-222a57e04977 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.159445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269a0d25de2c4a56ae143aaba0d4a2fa'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.161507 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e074-2de8-4809-895e-222a57e04977 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.168607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4908b-a62d-4ddc-84e5-2d6bd02c0c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.169414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4908b-a62d-4ddc-84e5-2d6bd02c0c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.169873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4908b-a62d-4ddc-84e5-2d6bd02c0c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.170195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4908b-a62d-4ddc-84e5-2d6bd02c0c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.171378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4908b-a62d-4ddc-84e5-2d6bd02c0c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.172940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269a0d25de2c4a56ae143aaba0d4a2fa'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.173596 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4908b-a62d-4ddc-84e5-2d6bd02c0c66 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.173707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269a0d25de2c4a56ae143aaba0d4a2fa'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.174305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269a0d25de2c4a56ae143aaba0d4a2fa'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.181235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269a0d25de2c4a56ae143aaba0d4a2fa'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.188886 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1014/2018] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:33.193512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4908b-a62d-4ddc-84e5-2d6bd02c0c66 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.199372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1ef4908b-a62d-4ddc-84e5-2d6bd02c0c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:33.199918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1005/2019] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:33 2022] DELETE /identity/v3/users/269a0d25de2c4a56ae143aaba0d4a2fa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:33.218722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4908b-a62d-4ddc-84e5-2d6bd02c0c66 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.298211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e3e8e-0e3a-4783-86a2-0e8ee4886b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.298899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e3e8e-0e3a-4783-86a2-0e8ee4886b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.299167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e3e8e-0e3a-4783-86a2-0e8ee4886b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.299439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e3e8e-0e3a-4783-86a2-0e8ee4886b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.300174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e3e8e-0e3a-4783-86a2-0e8ee4886b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.301764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e3e8e-0e3a-4783-86a2-0e8ee4886b81 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.313133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1015/2020] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:33.318398 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.335840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04b479-39cc-4de8-8420-b49c185890aa admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.343033 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4798e-b416-4450-b445-06cc0930e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.344005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4798e-b416-4450-b445-06cc0930e939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.344286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4798e-b416-4450-b445-06cc0930e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.344561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4798e-b416-4450-b445-06cc0930e939 admin admin] PATH_INFO: `/v3/projects/76fca2f8cb9249f39d4decaef06e84f0/users/0d13fe8115104d9090c127aaab30aa0c/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.364689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4798e-b416-4450-b445-06cc0930e939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fca2f8cb9249f39d4decaef06e84f0, user_id=0d13fe8115104d9090c127aaab30aa0c, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.369290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4798e-b416-4450-b445-06cc0930e939 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.402140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1006/2021] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:33 2022] PUT /identity/v3/projects/76fca2f8cb9249f39d4decaef06e84f0/users/0d13fe8115104d9090c127aaab30aa0c/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:33.405266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d228abc-ba0e-40be-8305-b66db2c6ce81 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.405874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d228abc-ba0e-40be-8305-b66db2c6ce81 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.406265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d228abc-ba0e-40be-8305-b66db2c6ce81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.448537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5d228abc-ba0e-40be-8305-b66db2c6ce81 None None] MFA Rules not processed for user `0d13fe8115104d9090c127aaab30aa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:33.449805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5d228abc-ba0e-40be-8305-b66db2c6ce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:33.526411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1016/2022] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:33.530828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4798e-b416-4450-b445-06cc0930e939 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.594460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4798e-b416-4450-b445-06cc0930e939 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.600236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61140e-ffa6-4fd3-9e51-f1186584d0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.600935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61140e-ffa6-4fd3-9e51-f1186584d0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.601265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61140e-ffa6-4fd3-9e51-f1186584d0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.601561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61140e-ffa6-4fd3-9e51-f1186584d0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.602574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61140e-ffa6-4fd3-9e51-f1186584d0b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.605453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61140e-ffa6-4fd3-9e51-f1186584d0b7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.633102 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d228abc-ba0e-40be-8305-b66db2c6ce81 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.635024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5d228abc-ba0e-40be-8305-b66db2c6ce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:33.648596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1007/2023] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:33 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:33.650945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d228abc-ba0e-40be-8305-b66db2c6ce81 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.653882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61140e-ffa6-4fd3-9e51-f1186584d0b7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.714726 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.715696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.716065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.716419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] PATH_INFO: `/v3/projects/168a2c37beb1481e8a135bae30faff15` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.717771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=168a2c37beb1481e8a135bae30faff15)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.720208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.721319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61140e-ffa6-4fd3-9e51-f1186584d0b7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.734772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1553-986a-44f0-80cc-6abd42e3ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.735491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1553-986a-44f0-80cc-6abd42e3ffa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.735770 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1553-986a-44f0-80cc-6abd42e3ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.736042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1553-986a-44f0-80cc-6abd42e3ffa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.736756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1553-986a-44f0-80cc-6abd42e3ffa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.738722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1553-986a-44f0-80cc-6abd42e3ffa4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.759133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1008/2024] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:33 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:33.763034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1553-986a-44f0-80cc-6abd42e3ffa4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.767925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168a2c37beb1481e8a135bae30faff15', 'request_id': 'req-a0ae481a-0d7c-477a-9a77-a261d79a83a3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.773906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1553-986a-44f0-80cc-6abd42e3ffa4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.774645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168a2c37beb1481e8a135bae30faff15', 'request_id': 'req-a0ae481a-0d7c-477a-9a77-a261d79a83a3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.782142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168a2c37beb1481e8a135bae30faff15', 'request_id': 'req-a0ae481a-0d7c-477a-9a77-a261d79a83a3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.792609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] The token cache is being invalidate because project 168a2c37beb1481e8a135bae30faff15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:33.792895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.793533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0ae481a-0d7c-477a-9a77-a261d79a83a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:33.795124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1017/2025] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:33 2022] DELETE /identity/v3/projects/168a2c37beb1481e8a135bae30faff15 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:33.799703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fb4a7-fb58-4aa4-8382-92d00410b0d9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.799986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fb4a7-fb58-4aa4-8382-92d00410b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.800262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fb4a7-fb58-4aa4-8382-92d00410b0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.819103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8a4fb4a7-fb58-4aa4-8382-92d00410b0d9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:33.820841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8a4fb4a7-fb58-4aa4-8382-92d00410b0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:33.829779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192e611-0f44-4a5a-80a4-9d1dad3b3e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.830522 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192e611-0f44-4a5a-80a4-9d1dad3b3e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.830918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192e611-0f44-4a5a-80a4-9d1dad3b3e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.831202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192e611-0f44-4a5a-80a4-9d1dad3b3e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.831924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192e611-0f44-4a5a-80a4-9d1dad3b3e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.833549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192e611-0f44-4a5a-80a4-9d1dad3b3e3a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.843927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1009/2026] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:33.848026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192e611-0f44-4a5a-80a4-9d1dad3b3e3a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.849863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7192e611-0f44-4a5a-80a4-9d1dad3b3e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:33.863171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192e611-0f44-4a5a-80a4-9d1dad3b3e3a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.868003 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedc256-1e91-4129-a8de-3fd1793c0a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.868905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedc256-1e91-4129-a8de-3fd1793c0a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.869193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedc256-1e91-4129-a8de-3fd1793c0a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.869501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedc256-1e91-4129-a8de-3fd1793c0a54 admin admin] PATH_INFO: `/v3/projects/977c3e2db0ac4e9a8e6bd7fab05f0729/users/494aa112f82b44e0848fd778e2efe210/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.878345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1018/2027] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:33.886205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb4b61-6c2c-436e-a7e0-d1d9222fda0e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.886518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb4b61-6c2c-436e-a7e0-d1d9222fda0e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.886795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb4b61-6c2c-436e-a7e0-d1d9222fda0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.888586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedc256-1e91-4129-a8de-3fd1793c0a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=977c3e2db0ac4e9a8e6bd7fab05f0729, user_id=494aa112f82b44e0848fd778e2efe210, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.891346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedc256-1e91-4129-a8de-3fd1793c0a54 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.904979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1010/2028] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:33 2022] PUT /identity/v3/projects/977c3e2db0ac4e9a8e6bd7fab05f0729/users/494aa112f82b44e0848fd778e2efe210/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:33.905691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5bdb4b61-6c2c-436e-a7e0-d1d9222fda0e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:33.906991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5bdb4b61-6c2c-436e-a7e0-d1d9222fda0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:33.908857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedc256-1e91-4129-a8de-3fd1793c0a54 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.965299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1019/2029] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:33.968908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedc256-1e91-4129-a8de-3fd1793c0a54 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.969525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb4b61-6c2c-436e-a7e0-d1d9222fda0e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.973884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e879e8-d1fa-479e-8f80-79259d32c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.974522 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e879e8-d1fa-479e-8f80-79259d32c83c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.974805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e879e8-d1fa-479e-8f80-79259d32c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.975080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e879e8-d1fa-479e-8f80-79259d32c83c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.975796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e879e8-d1fa-479e-8f80-79259d32c83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.978201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e879e8-d1fa-479e-8f80-79259d32c83c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.978873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb4b61-6c2c-436e-a7e0-d1d9222fda0e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:33.983440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c829f-892f-42a5-b05f-db02dfb2fff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:33.984075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c829f-892f-42a5-b05f-db02dfb2fff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:33.984470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c829f-892f-42a5-b05f-db02dfb2fff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:33.984750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c829f-892f-42a5-b05f-db02dfb2fff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:33.985471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c829f-892f-42a5-b05f-db02dfb2fff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:33.985774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c829f-892f-42a5-b05f-db02dfb2fff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:33.987372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c829f-892f-42a5-b05f-db02dfb2fff8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:33.991019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1011/2030] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:33.992584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e879e8-d1fa-479e-8f80-79259d32c83c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:33.999920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1020/2031] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:43:34.002415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e879e8-d1fa-479e-8f80-79259d32c83c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:34.003939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c829f-892f-42a5-b05f-db02dfb2fff8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:34.007179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd0857-d76d-4769-9a6d-eda4f10821ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:34.008085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0857-d76d-4769-9a6d-eda4f10821ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.008364 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0857-d76d-4769-9a6d-eda4f10821ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.008637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0857-d76d-4769-9a6d-eda4f10821ea admin admin] PATH_INFO: `/v3/projects/977c3e2db0ac4e9a8e6bd7fab05f0729/users/494aa112f82b44e0848fd778e2efe210/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.010631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd0857-d76d-4769-9a6d-eda4f10821ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=977c3e2db0ac4e9a8e6bd7fab05f0729, user_id=494aa112f82b44e0848fd778e2efe210, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:34.013072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c829f-892f-42a5-b05f-db02dfb2fff8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:34.013291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd0857-d76d-4769-9a6d-eda4f10821ea admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:34.017553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683a4cd-e622-494f-a8b4-e9cad533e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:34.018201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683a4cd-e622-494f-a8b4-e9cad533e111 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.018482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683a4cd-e622-494f-a8b4-e9cad533e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.018758 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683a4cd-e622-494f-a8b4-e9cad533e111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.019426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683a4cd-e622-494f-a8b4-e9cad533e111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:34.021276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683a4cd-e622-494f-a8b4-e9cad533e111 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:34.023515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1012/2032] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:33 2022] PUT /identity/v3/projects/977c3e2db0ac4e9a8e6bd7fab05f0729/users/494aa112f82b44e0848fd778e2efe210/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:34.034294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54931-037d-415c-95bb-c5c40c5d065d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.034581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54931-037d-415c-95bb-c5c40c5d065d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.034867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54931-037d-415c-95bb-c5c40c5d065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.047584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1021/2033] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:34 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:34.051528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683a4cd-e622-494f-a8b4-e9cad533e111 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:34.061328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d2e54931-037d-415c-95bb-c5c40c5d065d None None] MFA Rules not processed for user `494aa112f82b44e0848fd778e2efe210`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:34.062583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d2e54931-037d-415c-95bb-c5c40c5d065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:34.109767 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683a4cd-e622-494f-a8b4-e9cad533e111 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:34.114401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763164a-b52b-421e-9f56-f13d1dc7e911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:34.115057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763164a-b52b-421e-9f56-f13d1dc7e911 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.115338 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763164a-b52b-421e-9f56-f13d1dc7e911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.115610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763164a-b52b-421e-9f56-f13d1dc7e911 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.116291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763164a-b52b-421e-9f56-f13d1dc7e911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:34.118843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763164a-b52b-421e-9f56-f13d1dc7e911 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:34.127531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1013/2034] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:34.141663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1022/2035] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:34 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:34.143150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e54931-037d-415c-95bb-c5c40c5d065d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:34.144076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763164a-b52b-421e-9f56-f13d1dc7e911 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:34.145983 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8763164a-b52b-421e-9f56-f13d1dc7e911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:34.154833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e54931-037d-415c-95bb-c5c40c5d065d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:34.159423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a23b-a27a-4857-98a1-f3c4a95b171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:34.160089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a23b-a27a-4857-98a1-f3c4a95b171b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.160377 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a23b-a27a-4857-98a1-f3c4a95b171b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.160656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a23b-a27a-4857-98a1-f3c4a95b171b admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.161376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a23b-a27a-4857-98a1-f3c4a95b171b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:34.163021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a23b-a27a-4857-98a1-f3c4a95b171b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:34.172803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1014/2036] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:34.176708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a23b-a27a-4857-98a1-f3c4a95b171b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:34.186611 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a23b-a27a-4857-98a1-f3c4a95b171b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:34.191250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d21e4-7407-41e2-814d-2c5728ee008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:34.191935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d21e4-7407-41e2-814d-2c5728ee008d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.192219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d21e4-7407-41e2-814d-2c5728ee008d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.192501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d21e4-7407-41e2-814d-2c5728ee008d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.193220 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d21e4-7407-41e2-814d-2c5728ee008d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:34.194848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d21e4-7407-41e2-814d-2c5728ee008d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:34.201544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763164a-b52b-421e-9f56-f13d1dc7e911 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:34.205188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a4f7-49b4-44bd-a918-2d8d6c216fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:34.205570 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1015/2037] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:34.205833 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a4f7-49b4-44bd-a918-2d8d6c216fcf service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.206172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a4f7-49b4-44bd-a918-2d8d6c216fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.206452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a4f7-49b4-44bd-a918-2d8d6c216fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.209739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d21e4-7407-41e2-814d-2c5728ee008d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:34.216108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a4f7-49b4-44bd-a918-2d8d6c216fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:34.217537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a4f7-49b4-44bd-a918-2d8d6c216fcf service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:34.221486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d21e4-7407-41e2-814d-2c5728ee008d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:34.229192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1023/2038] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:34.234975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb238-6a65-4271-ac62-7dff6e9be52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:34.236628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb238-6a65-4271-ac62-7dff6e9be52b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.237020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb238-6a65-4271-ac62-7dff6e9be52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.237397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb238-6a65-4271-ac62-7dff6e9be52b admin admin] PATH_INFO: `/v3/projects/9bf9dcda23f14ae397cdbb7dde1e79fe/users/815dc2e355ed4ca1b20682dca905b713/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.255287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abb238-6a65-4271-ac62-7dff6e9be52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf9dcda23f14ae397cdbb7dde1e79fe, user_id=815dc2e355ed4ca1b20682dca905b713, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:34.257928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abb238-6a65-4271-ac62-7dff6e9be52b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:34.276300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1016/2039] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:34 2022] PUT /identity/v3/projects/9bf9dcda23f14ae397cdbb7dde1e79fe/users/815dc2e355ed4ca1b20682dca905b713/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:34.287770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3ddc-4fbe-414b-a650-174d5a6418e5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.288063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3ddc-4fbe-414b-a650-174d5a6418e5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.288437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3ddc-4fbe-414b-a650-174d5a6418e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.316905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-645f3ddc-4fbe-414b-a650-174d5a6418e5 None None] MFA Rules not processed for user `815dc2e355ed4ca1b20682dca905b713`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:34.317079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-645f3ddc-4fbe-414b-a650-174d5a6418e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:34.324944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb238-6a65-4271-ac62-7dff6e9be52b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:34.383111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1024/2040] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:34.385002 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb238-6a65-4271-ac62-7dff6e9be52b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:34.389016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:34.389721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.390052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.390354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.392305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:34.394949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f3ddc-4fbe-414b-a650-174d5a6418e5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:34.396245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-645f3ddc-4fbe-414b-a650-174d5a6418e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:34.453294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f3ddc-4fbe-414b-a650-174d5a6418e5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:34.453945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:34.455023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:34.457235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e63db-0340-4dc6-9afd-d494db18690c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22c0e889e1f842b2a6081f38aabd97ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:34.457872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e63db-0340-4dc6-9afd-d494db18690c service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:34.458178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e63db-0340-4dc6-9afd-d494db18690c service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:34.458448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e63db-0340-4dc6-9afd-d494db18690c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:34.465356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1017/2041] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:34.467606 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e63db-0340-4dc6-9afd-d494db18690c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:34.469011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e63db-0340-4dc6-9afd-d494db18690c service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:34.478527 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1025/2042] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:41.962459 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:41.964156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:42.029462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0871-fbc6-4b3b-bad4-76d5710e7e8f service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:42.034087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:42.034910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:42.035196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:42.035469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] PATH_INFO: `/v3/users/7f094b1223d44a66907a15a74691def9` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:42.036662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f094b1223d44a66907a15a74691def9)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:42.039535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:42.091345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f094b1223d44a66907a15a74691def9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.103346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f094b1223d44a66907a15a74691def9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.104120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f094b1223d44a66907a15a74691def9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.104720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f094b1223d44a66907a15a74691def9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.112103 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f094b1223d44a66907a15a74691def9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.131385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1018/2043] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:41 2022] DELETE /identity/v3/users/7f094b1223d44a66907a15a74691def9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:42.138052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661ec24-f79d-495a-9520-fc14fd74fb78 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:42.138716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661ec24-f79d-495a-9520-fc14fd74fb78 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:42.138716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661ec24-f79d-495a-9520-fc14fd74fb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:42.164574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1661ec24-f79d-495a-9520-fc14fd74fb78 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:42.165806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1661ec24-f79d-495a-9520-fc14fd74fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:42.231651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1026/2044] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:42.241566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:42.243037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:42.304855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03eff9b-e5b4-4b75-950a-107c36299fcb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:42.308990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63212789-588d-4f07-b48c-ad3d6722023c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:42.309649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63212789-588d-4f07-b48c-ad3d6722023c service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:42.309924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63212789-588d-4f07-b48c-ad3d6722023c service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:42.310380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63212789-588d-4f07-b48c-ad3d6722023c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:42.321268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63212789-588d-4f07-b48c-ad3d6722023c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:42.322964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63212789-588d-4f07-b48c-ad3d6722023c service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:42.334706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1019/2045] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:42.695806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661ec24-f79d-495a-9520-fc14fd74fb78 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:42.697975 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1661ec24-f79d-495a-9520-fc14fd74fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:42.713034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661ec24-f79d-495a-9520-fc14fd74fb78 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:42.717987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:42.718981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:42.719363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:42.719702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] PATH_INFO: `/v3/projects/4fc392e2a19641828e5a51cf84f828c3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:42.721003 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc392e2a19641828e5a51cf84f828c3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:42.723105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:42.777381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc392e2a19641828e5a51cf84f828c3', 'request_id': 'req-64464e84-f8c7-44c7-9324-384059c6f2d1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.783732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc392e2a19641828e5a51cf84f828c3', 'request_id': 'req-64464e84-f8c7-44c7-9324-384059c6f2d1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.792572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc392e2a19641828e5a51cf84f828c3', 'request_id': 'req-64464e84-f8c7-44c7-9324-384059c6f2d1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.803757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] The token cache is being invalidate because project 4fc392e2a19641828e5a51cf84f828c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:42.804188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.804882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.806525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1027/2046] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:42 2022] DELETE /identity/v3/projects/4fc392e2a19641828e5a51cf84f828c3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:42.811060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63212789-588d-4f07-b48c-ad3d6722023c service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:42.821718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63212789-588d-4f07-b48c-ad3d6722023c service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:42.888430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:42.890144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:42.890431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:42.890708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] PATH_INFO: `/v3/users/2085322b3bd94a949eb9c672e579f5d6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:42.891906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2085322b3bd94a949eb9c672e579f5d6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:42.893810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:42.941175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2085322b3bd94a949eb9c672e579f5d6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.954799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2085322b3bd94a949eb9c672e579f5d6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.955350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2085322b3bd94a949eb9c672e579f5d6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.956212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2085322b3bd94a949eb9c672e579f5d6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.964396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a62c9864-499d-4979-96a4-41017e02943d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2085322b3bd94a949eb9c672e579f5d6'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:42.977273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1020/2047] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:42 2022] DELETE /identity/v3/users/2085322b3bd94a949eb9c672e579f5d6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:43.318430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:43.321633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:43.338512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64464e84-f8c7-44c7-9324-384059c6f2d1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:43.414337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:43.415204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.415487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.415760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] PATH_INFO: `/v3/projects/be52cb6c4de54de898dc71586a8561bd` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.416972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be52cb6c4de54de898dc71586a8561bd)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:43.418962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:43.469277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be52cb6c4de54de898dc71586a8561bd', 'request_id': 'req-78d53ff0-cf39-4e23-95ce-25df27d7fb42'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.477261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be52cb6c4de54de898dc71586a8561bd', 'request_id': 'req-78d53ff0-cf39-4e23-95ce-25df27d7fb42'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.487817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be52cb6c4de54de898dc71586a8561bd', 'request_id': 'req-78d53ff0-cf39-4e23-95ce-25df27d7fb42'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.499952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] The token cache is being invalidate because project be52cb6c4de54de898dc71586a8561bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:43.500261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.500913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.502518 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1028/2048] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:43 2022] DELETE /identity/v3/projects/be52cb6c4de54de898dc71586a8561bd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:43.508142 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d9d05-caa5-4d3c-b9f3-2ae7491ff250 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.509177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d9d05-caa5-4d3c-b9f3-2ae7491ff250 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.509554 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d9d05-caa5-4d3c-b9f3-2ae7491ff250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.527660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-186d9d05-caa5-4d3c-b9f3-2ae7491ff250 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:43.529052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-186d9d05-caa5-4d3c-b9f3-2ae7491ff250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:43.577564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:43.579089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:43.597389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1021/2049] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:43.604511 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ae421-896e-4439-97e1-077341cac8d3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.604802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ae421-896e-4439-97e1-077341cac8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.605107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ae421-896e-4439-97e1-077341cac8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.623884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-402ae421-896e-4439-97e1-077341cac8d3 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:43.625128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-402ae421-896e-4439-97e1-077341cac8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:43.634024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1022/2050] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:43.638031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ae421-896e-4439-97e1-077341cac8d3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:43.647614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ae421-896e-4439-97e1-077341cac8d3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:43.652624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299679-dc0e-4e1b-bd4e-df98741d729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:43.653381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299679-dc0e-4e1b-bd4e-df98741d729d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.653741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299679-dc0e-4e1b-bd4e-df98741d729d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.654129 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299679-dc0e-4e1b-bd4e-df98741d729d admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.655021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299679-dc0e-4e1b-bd4e-df98741d729d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:43.655481 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299679-dc0e-4e1b-bd4e-df98741d729d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:43.657219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299679-dc0e-4e1b-bd4e-df98741d729d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:43.670160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1023/2051] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:43:43.672675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d53ff0-cf39-4e23-95ce-25df27d7fb42 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:43.674594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299679-dc0e-4e1b-bd4e-df98741d729d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:43.677579 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:43.678565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.678923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.679377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] PATH_INFO: `/v3/users/4f5da93be5a54edcaa51d41dacc433e7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.680660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5da93be5a54edcaa51d41dacc433e7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:43.682683 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:43.686211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299679-dc0e-4e1b-bd4e-df98741d729d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:43.691112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104e1af-172c-4b3c-bb92-f4770fc43e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:43.691810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104e1af-172c-4b3c-bb92-f4770fc43e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.692094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104e1af-172c-4b3c-bb92-f4770fc43e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.692370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104e1af-172c-4b3c-bb92-f4770fc43e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.693080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104e1af-172c-4b3c-bb92-f4770fc43e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:43.695640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104e1af-172c-4b3c-bb92-f4770fc43e74 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:43.730321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1024/2052] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:43 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:43.732013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104e1af-172c-4b3c-bb92-f4770fc43e74 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:43.746374 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5da93be5a54edcaa51d41dacc433e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.760321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5da93be5a54edcaa51d41dacc433e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.761180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5da93be5a54edcaa51d41dacc433e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.770966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5da93be5a54edcaa51d41dacc433e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.780272 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a10381a-4708-4f79-9551-82df61a87ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5da93be5a54edcaa51d41dacc433e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:43.787677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1029/2053] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:43 2022] DELETE /identity/v3/users/4f5da93be5a54edcaa51d41dacc433e7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:43.792373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1aaf3-0c6a-4bea-ba58-f90cf0c16f0a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.793532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1aaf3-0c6a-4bea-ba58-f90cf0c16f0a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.793813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1aaf3-0c6a-4bea-ba58-f90cf0c16f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.806246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104e1af-172c-4b3c-bb92-f4770fc43e74 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:43.813669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9ab1aaf3-0c6a-4bea-ba58-f90cf0c16f0a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:43.814981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9ab1aaf3-0c6a-4bea-ba58-f90cf0c16f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:43.865254 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61502d-d156-4e63-8529-7d0680ab1b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:43.866316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61502d-d156-4e63-8529-7d0680ab1b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.866433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61502d-d156-4e63-8529-7d0680ab1b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.867291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61502d-d156-4e63-8529-7d0680ab1b4c admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.868109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61502d-d156-4e63-8529-7d0680ab1b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:43.870265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61502d-d156-4e63-8529-7d0680ab1b4c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:43.878670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1030/2054] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:43.889402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1aaf3-0c6a-4bea-ba58-f90cf0c16f0a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:43.890887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9ab1aaf3-0c6a-4bea-ba58-f90cf0c16f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:43.894773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1025/2055] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:43 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:43.895756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61502d-d156-4e63-8529-7d0680ab1b4c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:43.897339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5b61502d-d156-4e63-8529-7d0680ab1b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:43.909477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61502d-d156-4e63-8529-7d0680ab1b4c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:43.914254 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ed72-03bc-4abe-b4e3-6930057f06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:43.914911 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ed72-03bc-4abe-b4e3-6930057f06d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.915198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ed72-03bc-4abe-b4e3-6930057f06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.915469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ed72-03bc-4abe-b4e3-6930057f06d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.916188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ed72-03bc-4abe-b4e3-6930057f06d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:43.917782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ed72-03bc-4abe-b4e3-6930057f06d2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:43.927458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1026/2056] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:43.931935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ed72-03bc-4abe-b4e3-6930057f06d2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:43.941664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ed72-03bc-4abe-b4e3-6930057f06d2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:43.946544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8dbb-5e52-41fd-b11b-06d50a2e4f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:43.947312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8dbb-5e52-41fd-b11b-06d50a2e4f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.947599 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8dbb-5e52-41fd-b11b-06d50a2e4f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.947876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8dbb-5e52-41fd-b11b-06d50a2e4f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.948502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1aaf3-0c6a-4bea-ba58-f90cf0c16f0a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:43.948603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8dbb-5e52-41fd-b11b-06d50a2e4f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:43.950218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8dbb-5e52-41fd-b11b-06d50a2e4f34 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:43.952543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b5ad3-d83e-41ca-bcf2-676bc4e0b72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:43.953259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5ad3-d83e-41ca-bcf2-676bc4e0b72d service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.953544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5ad3-d83e-41ca-bcf2-676bc4e0b72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.953821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5ad3-d83e-41ca-bcf2-676bc4e0b72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:43.961624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1027/2057] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:43.964081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5ad3-d83e-41ca-bcf2-676bc4e0b72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:43.965539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8dbb-5e52-41fd-b11b-06d50a2e4f34 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:43.966034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5ad3-d83e-41ca-bcf2-676bc4e0b72d service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:43.975236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1031/2058] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:43.978044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8dbb-5e52-41fd-b11b-06d50a2e4f34 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:43.982880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3bdcc-5e85-463f-b7c0-b37fc27d209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:43.983771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3bdcc-5e85-463f-b7c0-b37fc27d209c admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:43.984051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3bdcc-5e85-463f-b7c0-b37fc27d209c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:43.984350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3bdcc-5e85-463f-b7c0-b37fc27d209c admin admin] PATH_INFO: `/v3/projects/91dd406c96be45e7b8899425b9db96e2/users/15b8a672c393405b824d42f0ec7f3d70/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.000767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3bdcc-5e85-463f-b7c0-b37fc27d209c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91dd406c96be45e7b8899425b9db96e2, user_id=15b8a672c393405b824d42f0ec7f3d70, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.003538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3bdcc-5e85-463f-b7c0-b37fc27d209c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:44.016920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1028/2059] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:43 2022] PUT /identity/v3/projects/91dd406c96be45e7b8899425b9db96e2/users/15b8a672c393405b824d42f0ec7f3d70/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:44.029380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7405f37-4f47-4c2f-8e97-1d3606c6b9ce None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.029871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7405f37-4f47-4c2f-8e97-1d3606c6b9ce None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.030283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7405f37-4f47-4c2f-8e97-1d3606c6b9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.059020 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d7405f37-4f47-4c2f-8e97-1d3606c6b9ce None None] MFA Rules not processed for user `15b8a672c393405b824d42f0ec7f3d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:44.060378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d7405f37-4f47-4c2f-8e97-1d3606c6b9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:44.149082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1032/2060] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:44.153482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3bdcc-5e85-463f-b7c0-b37fc27d209c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:44.235242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3bdcc-5e85-463f-b7c0-b37fc27d209c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:44.239798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60e9e8-2c21-4632-8668-eac568700579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:44.240779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e9e8-2c21-4632-8668-eac568700579 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.241238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e9e8-2c21-4632-8668-eac568700579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.241638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e9e8-2c21-4632-8668-eac568700579 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.242666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60e9e8-2c21-4632-8668-eac568700579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.245640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60e9e8-2c21-4632-8668-eac568700579 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:44.282046 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1029/2061] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:44 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:44.287110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7405f37-4f47-4c2f-8e97-1d3606c6b9ce None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:44.299399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7405f37-4f47-4c2f-8e97-1d3606c6b9ce None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:44.336849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60e9e8-2c21-4632-8668-eac568700579 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:44.338696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9a60e9e8-2c21-4632-8668-eac568700579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:44.377404 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a2028-3b95-4ff0-b216-81434987c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:44.378141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a2028-3b95-4ff0-b216-81434987c627 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.378411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a2028-3b95-4ff0-b216-81434987c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.378688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a2028-3b95-4ff0-b216-81434987c627 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.379380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a2028-3b95-4ff0-b216-81434987c627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.381379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a2028-3b95-4ff0-b216-81434987c627 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:44.412640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1033/2062] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:44 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:44.417066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a2028-3b95-4ff0-b216-81434987c627 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:44.430495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a2028-3b95-4ff0-b216-81434987c627 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:44.437859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9c15d-f964-4574-a3af-20ea4adf91ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:44.438892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c15d-f964-4574-a3af-20ea4adf91ff admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.438892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c15d-f964-4574-a3af-20ea4adf91ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.439119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c15d-f964-4574-a3af-20ea4adf91ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.439853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9c15d-f964-4574-a3af-20ea4adf91ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.441556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9c15d-f964-4574-a3af-20ea4adf91ff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:44.457564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1034/2063] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:44.458923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9c15d-f964-4574-a3af-20ea4adf91ff admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:44.459663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60e9e8-2c21-4632-8668-eac568700579 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:44.466449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:44.467024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.467311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.467586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] PATH_INFO: `/v3/projects/1be0c3b5d4c44283afcbac4a419526cd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.469052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be0c3b5d4c44283afcbac4a419526cd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.471325 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:44.472842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9c15d-f964-4574-a3af-20ea4adf91ff admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:44.479399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5869c86-f7ca-4782-878e-38fa8325c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:44.480490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5869c86-f7ca-4782-878e-38fa8325c288 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.480490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5869c86-f7ca-4782-878e-38fa8325c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.480686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5869c86-f7ca-4782-878e-38fa8325c288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.481413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5869c86-f7ca-4782-878e-38fa8325c288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.483222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5869c86-f7ca-4782-878e-38fa8325c288 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:44.494265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1035/2064] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:44.498292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5869c86-f7ca-4782-878e-38fa8325c288 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:44.510135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5869c86-f7ca-4782-878e-38fa8325c288 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:44.519345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408eec5-e17e-4376-a791-6c5e23250bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:44.520471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408eec5-e17e-4376-a791-6c5e23250bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.520589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408eec5-e17e-4376-a791-6c5e23250bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.520774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408eec5-e17e-4376-a791-6c5e23250bb1 admin admin] PATH_INFO: `/v3/projects/2838f4fbc16541b6ab73bf807dc58b10/users/fda25346e0af4052b1d886f91e3ddb7c/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.544657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408eec5-e17e-4376-a791-6c5e23250bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2838f4fbc16541b6ab73bf807dc58b10, user_id=fda25346e0af4052b1d886f91e3ddb7c, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.547547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be0c3b5d4c44283afcbac4a419526cd', 'request_id': 'req-2e374b33-c56d-41fa-8ce4-527488adbe59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.548493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408eec5-e17e-4376-a791-6c5e23250bb1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:44.554638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be0c3b5d4c44283afcbac4a419526cd', 'request_id': 'req-2e374b33-c56d-41fa-8ce4-527488adbe59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.563095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be0c3b5d4c44283afcbac4a419526cd', 'request_id': 'req-2e374b33-c56d-41fa-8ce4-527488adbe59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.564267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1036/2065] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:44 2022] PUT /identity/v3/projects/2838f4fbc16541b6ab73bf807dc58b10/users/fda25346e0af4052b1d886f91e3ddb7c/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:44.576539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] The token cache is being invalidate because project 1be0c3b5d4c44283afcbac4a419526cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:44.576748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8b70-e484-40fc-93a1-968f6b042043 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.577036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8b70-e484-40fc-93a1-968f6b042043 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.577513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.577613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8b70-e484-40fc-93a1-968f6b042043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.578730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.580731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1030/2066] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:44 2022] DELETE /identity/v3/projects/1be0c3b5d4c44283afcbac4a419526cd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:44.584542 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:44.586876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:44.613509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-801a8b70-e484-40fc-93a1-968f6b042043 None None] MFA Rules not processed for user `fda25346e0af4052b1d886f91e3ddb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:44.614759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-801a8b70-e484-40fc-93a1-968f6b042043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:44.661509 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e374b33-c56d-41fa-8ce4-527488adbe59 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:44.685421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1037/2067] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:44.686351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8b70-e484-40fc-93a1-968f6b042043 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:44.687925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-801a8b70-e484-40fc-93a1-968f6b042043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:44.721421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:44.722447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.722733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.723023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] PATH_INFO: `/v3/users/ae3283c04da64a5d853c66b4f0f66d8d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.724260 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3283c04da64a5d853c66b4f0f66d8d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.728816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:44.764424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8b70-e484-40fc-93a1-968f6b042043 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:44.768039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:44.768926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.769204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.769477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] PATH_INFO: `/v3/users/0d13fe8115104d9090c127aaab30aa0c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.770713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d13fe8115104d9090c127aaab30aa0c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.772644 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:44.773437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3283c04da64a5d853c66b4f0f66d8d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.784770 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3283c04da64a5d853c66b4f0f66d8d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.785449 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3283c04da64a5d853c66b4f0f66d8d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.786162 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3283c04da64a5d853c66b4f0f66d8d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.792668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3283c04da64a5d853c66b4f0f66d8d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.805798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1031/2068] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:44 2022] DELETE /identity/v3/users/ae3283c04da64a5d853c66b4f0f66d8d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:44.806476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:44.807816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:44.824560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d13fe8115104d9090c127aaab30aa0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.844803 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d13fe8115104d9090c127aaab30aa0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.845723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d13fe8115104d9090c127aaab30aa0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.859254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d13fe8115104d9090c127aaab30aa0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.869820 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f0361c03-5e09-4f3a-b642-9a2acd6f5c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d13fe8115104d9090c127aaab30aa0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:44.878048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1038/2069] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:44 2022] DELETE /identity/v3/users/0d13fe8115104d9090c127aaab30aa0c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:44.881610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fc65b-e8ba-4791-8707-fbf41532d7a1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.882060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fc65b-e8ba-4791-8707-fbf41532d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.882448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fc65b-e8ba-4791-8707-fbf41532d7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.897759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996df08-183f-4e84-9732-62dc3858ca6a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:44.901634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-833fc65b-e8ba-4791-8707-fbf41532d7a1 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:44.902981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-833fc65b-e8ba-4791-8707-fbf41532d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:44.968125 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9e5b6-45a1-4884-857f-4bb1d6d3a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:44.968781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9e5b6-45a1-4884-857f-4bb1d6d3a57b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:44.969064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9e5b6-45a1-4884-857f-4bb1d6d3a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:44.969344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9e5b6-45a1-4884-857f-4bb1d6d3a57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:44.970051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9e5b6-45a1-4884-857f-4bb1d6d3a57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:44.971967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9e5b6-45a1-4884-857f-4bb1d6d3a57b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.002560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1039/2070] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:45.005818 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1032/2071] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:44 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:45.007072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fc65b-e8ba-4791-8707-fbf41532d7a1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.009036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-833fc65b-e8ba-4791-8707-fbf41532d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.012831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9e5b6-45a1-4884-857f-4bb1d6d3a57b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.016058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-56f9e5b6-45a1-4884-857f-4bb1d6d3a57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.021197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fc65b-e8ba-4791-8707-fbf41532d7a1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.083523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9e5b6-45a1-4884-857f-4bb1d6d3a57b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.087933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b37c1-b862-48fd-a8e9-6ec1600d6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.088748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b37c1-b862-48fd-a8e9-6ec1600d6f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.089133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b37c1-b862-48fd-a8e9-6ec1600d6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.089508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b37c1-b862-48fd-a8e9-6ec1600d6f79 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.090707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce5481-e242-4f2e-885b-f7fb0bf54dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.091125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b37c1-b862-48fd-a8e9-6ec1600d6f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.091712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce5481-e242-4f2e-885b-f7fb0bf54dbc service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.092058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce5481-e242-4f2e-885b-f7fb0bf54dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.092362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce5481-e242-4f2e-885b-f7fb0bf54dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.093661 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b37c1-b862-48fd-a8e9-6ec1600d6f79 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.113481 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce5481-e242-4f2e-885b-f7fb0bf54dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.115113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce5481-e242-4f2e-885b-f7fb0bf54dbc service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.119554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1040/2072] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:45 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:45.123533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b37c1-b862-48fd-a8e9-6ec1600d6f79 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.129326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1033/2073] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:45.133372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b37c1-b862-48fd-a8e9-6ec1600d6f79 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.138498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489990e-0f9f-4e15-a865-adaa1854d8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.139158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489990e-0f9f-4e15-a865-adaa1854d8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.139433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489990e-0f9f-4e15-a865-adaa1854d8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.139706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489990e-0f9f-4e15-a865-adaa1854d8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.142047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489990e-0f9f-4e15-a865-adaa1854d8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.142203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489990e-0f9f-4e15-a865-adaa1854d8cd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.154745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1041/2074] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:45.158537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce5481-e242-4f2e-885b-f7fb0bf54dbc service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.171205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce5481-e242-4f2e-885b-f7fb0bf54dbc service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.178522 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8f145-2a34-46a0-9edb-d110a9f272f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.180553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8f145-2a34-46a0-9edb-d110a9f272f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.181253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8f145-2a34-46a0-9edb-d110a9f272f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.181253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8f145-2a34-46a0-9edb-d110a9f272f9 admin admin] PATH_INFO: `/v3/projects/1057cfe014824408b20fb07a551db1f6/users/780050dddfcc43bca4a57c1bbed22364/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.199384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8f145-2a34-46a0-9edb-d110a9f272f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1057cfe014824408b20fb07a551db1f6, user_id=780050dddfcc43bca4a57c1bbed22364, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.202197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8f145-2a34-46a0-9edb-d110a9f272f9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.215102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1034/2075] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:45 2022] PUT /identity/v3/projects/1057cfe014824408b20fb07a551db1f6/users/780050dddfcc43bca4a57c1bbed22364/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:45.219069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489990e-0f9f-4e15-a865-adaa1854d8cd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.231294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489990e-0f9f-4e15-a865-adaa1854d8cd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.232731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8f145-2a34-46a0-9edb-d110a9f272f9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.235243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-59d8f145-2a34-46a0-9edb-d110a9f272f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.296699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815515f-356c-4ab0-9942-bd341c2fd05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.297166 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815515f-356c-4ab0-9942-bd341c2fd05a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.297451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815515f-356c-4ab0-9942-bd341c2fd05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.297748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815515f-356c-4ab0-9942-bd341c2fd05a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.298877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815515f-356c-4ab0-9942-bd341c2fd05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.300364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815515f-356c-4ab0-9942-bd341c2fd05a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.315011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1042/2076] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:45.316271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815515f-356c-4ab0-9942-bd341c2fd05a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.322446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8f145-2a34-46a0-9edb-d110a9f272f9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.328106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815515f-356c-4ab0-9942-bd341c2fd05a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.329061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.330605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.330605 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.330840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] PATH_INFO: `/v3/projects/4f3d1c45c7894691ac6b58cf75e077ce` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.331977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3d1c45c7894691ac6b58cf75e077ce)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.333898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.334476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f84567-40ab-4072-9290-33760e3ab9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.335975 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84567-40ab-4072-9290-33760e3ab9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.336526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84567-40ab-4072-9290-33760e3ab9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.336890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84567-40ab-4072-9290-33760e3ab9e5 admin admin] PATH_INFO: `/v3/projects/1057cfe014824408b20fb07a551db1f6/users/780050dddfcc43bca4a57c1bbed22364/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.339115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f84567-40ab-4072-9290-33760e3ab9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1057cfe014824408b20fb07a551db1f6, user_id=780050dddfcc43bca4a57c1bbed22364, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.342398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f84567-40ab-4072-9290-33760e3ab9e5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.358453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1043/2077] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:45 2022] PUT /identity/v3/projects/1057cfe014824408b20fb07a551db1f6/users/780050dddfcc43bca4a57c1bbed22364/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:45.370259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e603b-66e4-40cc-a59e-5c5133b72527 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.370524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e603b-66e4-40cc-a59e-5c5133b72527 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.370844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e603b-66e4-40cc-a59e-5c5133b72527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.398582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3d1c45c7894691ac6b58cf75e077ce', 'request_id': 'req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.399119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-152e603b-66e4-40cc-a59e-5c5133b72527 None None] MFA Rules not processed for user `780050dddfcc43bca4a57c1bbed22364`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:45.400358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-152e603b-66e4-40cc-a59e-5c5133b72527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.406415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3d1c45c7894691ac6b58cf75e077ce', 'request_id': 'req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.415944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3d1c45c7894691ac6b58cf75e077ce', 'request_id': 'req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.428512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] The token cache is being invalidate because project 4f3d1c45c7894691ac6b58cf75e077ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:45.428800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.429490 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1358916-c971-45f2-9df2-0ecf2ab2d6b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.431132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1035/2078] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:45 2022] DELETE /identity/v3/projects/4f3d1c45c7894691ac6b58cf75e077ce => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:45.438128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71051df6-870d-45ee-aa5d-450643b6edd5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.438128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71051df6-870d-45ee-aa5d-450643b6edd5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.438128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71051df6-870d-45ee-aa5d-450643b6edd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.459212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-71051df6-870d-45ee-aa5d-450643b6edd5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:45.461252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-71051df6-870d-45ee-aa5d-450643b6edd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.516350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1044/2079] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:45.529476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e603b-66e4-40cc-a59e-5c5133b72527 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.531554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-152e603b-66e4-40cc-a59e-5c5133b72527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.563408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1036/2080] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:45.572357 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a23d-181a-4d5d-93b7-0fb00d3ada82 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.572932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a23d-181a-4d5d-93b7-0fb00d3ada82 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.573362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a23d-181a-4d5d-93b7-0fb00d3ada82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.597562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4697a23d-181a-4d5d-93b7-0fb00d3ada82 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:45.599259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4697a23d-181a-4d5d-93b7-0fb00d3ada82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.607906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e603b-66e4-40cc-a59e-5c5133b72527 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.608965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1037/2081] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:45.609868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a23d-181a-4d5d-93b7-0fb00d3ada82 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.611408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4697a23d-181a-4d5d-93b7-0fb00d3ada82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.615498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec417-0a73-4535-9f68-2cdc05deec0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.616145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec417-0a73-4535-9f68-2cdc05deec0b service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.616971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec417-0a73-4535-9f68-2cdc05deec0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.617233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec417-0a73-4535-9f68-2cdc05deec0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.619032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d7aec417-0a73-4535-9f68-2cdc05deec0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.628127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a23d-181a-4d5d-93b7-0fb00d3ada82 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.644963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.645844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.646210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.646544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] PATH_INFO: `/v3/projects/76fca2f8cb9249f39d4decaef06e84f0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.647863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] RBAC: Authorizing `identity:delete_project(project_id=76fca2f8cb9249f39d4decaef06e84f0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.650596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.707529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aec417-0a73-4535-9f68-2cdc05deec0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.709628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aec417-0a73-4535-9f68-2cdc05deec0b service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.730794 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1045/2082] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:45.732193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec417-0a73-4535-9f68-2cdc05deec0b service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.736174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76fca2f8cb9249f39d4decaef06e84f0', 'request_id': 'req-8dc3a0e5-25ec-45b3-a3ea-38676794435b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.747346 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec417-0a73-4535-9f68-2cdc05deec0b service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.751863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76fca2f8cb9249f39d4decaef06e84f0', 'request_id': 'req-8dc3a0e5-25ec-45b3-a3ea-38676794435b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.767717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76fca2f8cb9249f39d4decaef06e84f0', 'request_id': 'req-8dc3a0e5-25ec-45b3-a3ea-38676794435b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.786714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] The token cache is being invalidate because project 76fca2f8cb9249f39d4decaef06e84f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:45.787000 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.787674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:45.790353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1038/2083] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:45 2022] DELETE /identity/v3/projects/76fca2f8cb9249f39d4decaef06e84f0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:45.793831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.796232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.851525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.852467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.852745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.853019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.853753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:45.854074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.855839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.871245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1046/2084] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:43:45.875778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.878089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:45.894174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a054bbd-510e-4746-91b4-8a5b634799d6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.897957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3a0e5-25ec-45b3-a3ea-38676794435b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:45.902276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91306-6aff-4e7e-b3b6-e8f24e5b31ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.902962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91306-6aff-4e7e-b3b6-e8f24e5b31ff admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.903651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:45.904502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91306-6aff-4e7e-b3b6-e8f24e5b31ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.904721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:45.904838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:45.905046 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] PATH_INFO: `/v3/users/494aa112f82b44e0848fd778e2efe210` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.905862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91306-6aff-4e7e-b3b6-e8f24e5b31ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:45.906315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=494aa112f82b44e0848fd778e2efe210)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.906637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91306-6aff-4e7e-b3b6-e8f24e5b31ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:45.908368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.910810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91306-6aff-4e7e-b3b6-e8f24e5b31ff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:45.953420 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1047/2085] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:45 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:45.957364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91306-6aff-4e7e-b3b6-e8f24e5b31ff admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:45.982566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '494aa112f82b44e0848fd778e2efe210'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.000799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '494aa112f82b44e0848fd778e2efe210'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.002785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '494aa112f82b44e0848fd778e2efe210'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.003603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '494aa112f82b44e0848fd778e2efe210'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.016065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '494aa112f82b44e0848fd778e2efe210'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.037787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91306-6aff-4e7e-b3b6-e8f24e5b31ff admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.043108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1039/2086] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:45 2022] DELETE /identity/v3/users/494aa112f82b44e0848fd778e2efe210 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:46.044460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e6f4f-5c9b-492b-885e-f5c0859e14ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.045443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6f4f-5c9b-492b-885e-f5c0859e14ce admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.045638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6f4f-5c9b-492b-885e-f5c0859e14ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.066302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6f4f-5c9b-492b-885e-f5c0859e14ce admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.067187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e6f4f-5c9b-492b-885e-f5c0859e14ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.069538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e6f4f-5c9b-492b-885e-f5c0859e14ce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.120813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1048/2087] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:45 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:46.125521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.127385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:46.259695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4c2c-2f7a-4f24-9581-e2a0493f6a1e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.266441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593198c-ec6e-4ca7-9301-26d8e33c5b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.267665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593198c-ec6e-4ca7-9301-26d8e33c5b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.267958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593198c-ec6e-4ca7-9301-26d8e33c5b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.268369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593198c-ec6e-4ca7-9301-26d8e33c5b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.274587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593198c-ec6e-4ca7-9301-26d8e33c5b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.276500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593198c-ec6e-4ca7-9301-26d8e33c5b49 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.291577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1040/2088] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:46.296096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e6f4f-5c9b-492b-885e-f5c0859e14ce admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.321464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e6f4f-5c9b-492b-885e-f5c0859e14ce admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.337920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17bfb-4207-4e2d-b3f8-cb803f3a4ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.338619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17bfb-4207-4e2d-b3f8-cb803f3a4ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.338895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17bfb-4207-4e2d-b3f8-cb803f3a4ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.339163 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17bfb-4207-4e2d-b3f8-cb803f3a4ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.339899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e17bfb-4207-4e2d-b3f8-cb803f3a4ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.341484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e17bfb-4207-4e2d-b3f8-cb803f3a4ce1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.352587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1049/2089] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:46.356771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593198c-ec6e-4ca7-9301-26d8e33c5b49 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.368199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593198c-ec6e-4ca7-9301-26d8e33c5b49 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.372941 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b24d9-6fcf-40c5-a31a-44f3f2c9fafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.373858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b24d9-6fcf-40c5-a31a-44f3f2c9fafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.374176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b24d9-6fcf-40c5-a31a-44f3f2c9fafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.374447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b24d9-6fcf-40c5-a31a-44f3f2c9fafb admin admin] PATH_INFO: `/v3/projects/c9ce4a215ef14683ab8fc38726ecef35/users/e9dd7c10420c4d908309dc9f45b090b7/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.389258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b24d9-6fcf-40c5-a31a-44f3f2c9fafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ce4a215ef14683ab8fc38726ecef35, user_id=e9dd7c10420c4d908309dc9f45b090b7, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.392134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b24d9-6fcf-40c5-a31a-44f3f2c9fafb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.406167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1041/2090] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:46 2022] PUT /identity/v3/projects/c9ce4a215ef14683ab8fc38726ecef35/users/e9dd7c10420c4d908309dc9f45b090b7/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:46.418889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370a51f-3d47-4910-ad4e-5b46b5060310 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.419397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370a51f-3d47-4910-ad4e-5b46b5060310 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.419570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370a51f-3d47-4910-ad4e-5b46b5060310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.448357 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4370a51f-3d47-4910-ad4e-5b46b5060310 None None] MFA Rules not processed for user `e9dd7c10420c4d908309dc9f45b090b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:46.449645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4370a51f-3d47-4910-ad4e-5b46b5060310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:46.451158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b24d9-6fcf-40c5-a31a-44f3f2c9fafb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.452908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c00b24d9-6fcf-40c5-a31a-44f3f2c9fafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:46.521400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1050/2091] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:46.521957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b24d9-6fcf-40c5-a31a-44f3f2c9fafb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.526478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370a51f-3d47-4910-ad4e-5b46b5060310 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.527526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.528148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.528645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.528923 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] PATH_INFO: `/v3/projects/977c3e2db0ac4e9a8e6bd7fab05f0729` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.530340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=977c3e2db0ac4e9a8e6bd7fab05f0729)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.532615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.547037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370a51f-3d47-4910-ad4e-5b46b5060310 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.552506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf27fb-181b-491e-9a12-3bb7f5007047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.553359 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf27fb-181b-491e-9a12-3bb7f5007047 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.553657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf27fb-181b-491e-9a12-3bb7f5007047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.554561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf27fb-181b-491e-9a12-3bb7f5007047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.555427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf27fb-181b-491e-9a12-3bb7f5007047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.557326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf27fb-181b-491e-9a12-3bb7f5007047 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.586712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1051/2092] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:46 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:46.590605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf27fb-181b-491e-9a12-3bb7f5007047 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.592854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '977c3e2db0ac4e9a8e6bd7fab05f0729', 'request_id': 'req-81631632-3dc0-4c55-a383-027eabadaac7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.598912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '977c3e2db0ac4e9a8e6bd7fab05f0729', 'request_id': 'req-81631632-3dc0-4c55-a383-027eabadaac7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.607468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '977c3e2db0ac4e9a8e6bd7fab05f0729', 'request_id': 'req-81631632-3dc0-4c55-a383-027eabadaac7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.618776 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] The token cache is being invalidate because project 977c3e2db0ac4e9a8e6bd7fab05f0729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:46.619063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.619730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-81631632-3dc0-4c55-a383-027eabadaac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:46.621321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1042/2093] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:46 2022] DELETE /identity/v3/projects/977c3e2db0ac4e9a8e6bd7fab05f0729 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:46.625874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c492e-ff7e-416e-92ed-77e438ff0624 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.626193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c492e-ff7e-416e-92ed-77e438ff0624 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.626481 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c492e-ff7e-416e-92ed-77e438ff0624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.645314 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-624c492e-ff7e-416e-92ed-77e438ff0624 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:46.646544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-624c492e-ff7e-416e-92ed-77e438ff0624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:46.651434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf27fb-181b-491e-9a12-3bb7f5007047 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.655552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1043/2094] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:46.662720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e2443-a49b-4e5c-9930-5a74cb88bd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.663433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e2443-a49b-4e5c-9930-5a74cb88bd6f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.663635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690260e-0f7d-4ffb-8a04-5f3de493f703 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.663732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e2443-a49b-4e5c-9930-5a74cb88bd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.663988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e2443-a49b-4e5c-9930-5a74cb88bd6f admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.664080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690260e-0f7d-4ffb-8a04-5f3de493f703 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.664317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690260e-0f7d-4ffb-8a04-5f3de493f703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.664732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e2443-a49b-4e5c-9930-5a74cb88bd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.666918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e2443-a49b-4e5c-9930-5a74cb88bd6f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.683656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b690260e-0f7d-4ffb-8a04-5f3de493f703 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:46.684929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b690260e-0f7d-4ffb-8a04-5f3de493f703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:46.690125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1052/2095] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:46 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:46.691102 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e2443-a49b-4e5c-9930-5a74cb88bd6f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.692648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff4e2443-a49b-4e5c-9930-5a74cb88bd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:46.693225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1044/2096] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:46.697842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690260e-0f7d-4ffb-8a04-5f3de493f703 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.705491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e2443-a49b-4e5c-9930-5a74cb88bd6f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.708514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690260e-0f7d-4ffb-8a04-5f3de493f703 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.710924 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c4ece-147a-47b3-999e-a911c20431eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.711591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4ece-147a-47b3-999e-a911c20431eb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.712380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4ece-147a-47b3-999e-a911c20431eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.712658 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4ece-147a-47b3-999e-a911c20431eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.713391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c4ece-147a-47b3-999e-a911c20431eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.714594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a7a0-432a-4fd9-b2c0-9ba2382a70c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.715014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c4ece-147a-47b3-999e-a911c20431eb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.715244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a7a0-432a-4fd9-b2c0-9ba2382a70c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.715524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a7a0-432a-4fd9-b2c0-9ba2382a70c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.715796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a7a0-432a-4fd9-b2c0-9ba2382a70c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.716520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a7a0-432a-4fd9-b2c0-9ba2382a70c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:46.716821 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a7a0-432a-4fd9-b2c0-9ba2382a70c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.718437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a7a0-432a-4fd9-b2c0-9ba2382a70c6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.725009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1053/2097] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:46.729476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c4ece-147a-47b3-999e-a911c20431eb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.736584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1045/2098] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:43:46.737676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a7a0-432a-4fd9-b2c0-9ba2382a70c6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.739687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c4ece-147a-47b3-999e-a911c20431eb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.744297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632c19-30fe-41d9-b2c0-bc76381ecd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.745192 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632c19-30fe-41d9-b2c0-bc76381ecd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.745471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632c19-30fe-41d9-b2c0-bc76381ecd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.745737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632c19-30fe-41d9-b2c0-bc76381ecd30 admin admin] PATH_INFO: `/v3/projects/487f45bf2d8a41539d326ba304e40cee/users/832e68600f8049a4a3ed90622a920ead/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.748696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a7a0-432a-4fd9-b2c0-9ba2382a70c6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.755835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6897a0-4cf3-4442-915c-558da10ae033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.756557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6897a0-4cf3-4442-915c-558da10ae033 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.756901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6897a0-4cf3-4442-915c-558da10ae033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.757694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6897a0-4cf3-4442-915c-558da10ae033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.758444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6897a0-4cf3-4442-915c-558da10ae033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.760389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6897a0-4cf3-4442-915c-558da10ae033 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.763132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad632c19-30fe-41d9-b2c0-bc76381ecd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487f45bf2d8a41539d326ba304e40cee, user_id=832e68600f8049a4a3ed90622a920ead, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.765846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad632c19-30fe-41d9-b2c0-bc76381ecd30 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.779591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1054/2099] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:46 2022] PUT /identity/v3/projects/487f45bf2d8a41539d326ba304e40cee/users/832e68600f8049a4a3ed90622a920ead/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:46.783312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632c19-30fe-41d9-b2c0-bc76381ecd30 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.790973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1046/2100] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:46 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:46.792350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6897a0-4cf3-4442-915c-558da10ae033 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.849924 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632c19-30fe-41d9-b2c0-bc76381ecd30 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.853670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6897a0-4cf3-4442-915c-558da10ae033 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.855081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ee8ad-5916-462b-93a2-dc5fb1f89db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.855771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ee8ad-5916-462b-93a2-dc5fb1f89db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.856055 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ee8ad-5916-462b-93a2-dc5fb1f89db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.856331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ee8ad-5916-462b-93a2-dc5fb1f89db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.857084 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ee8ad-5916-462b-93a2-dc5fb1f89db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.858899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ee8ad-5916-462b-93a2-dc5fb1f89db0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.859675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd9854-bf77-4354-8500-b4004b1b1988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.864608 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd9854-bf77-4354-8500-b4004b1b1988 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.865145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd9854-bf77-4354-8500-b4004b1b1988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.865563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd9854-bf77-4354-8500-b4004b1b1988 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.866993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd9854-bf77-4354-8500-b4004b1b1988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.869071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd9854-bf77-4354-8500-b4004b1b1988 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.870048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1055/2101] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:46.873742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ee8ad-5916-462b-93a2-dc5fb1f89db0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.885561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ee8ad-5916-462b-93a2-dc5fb1f89db0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.891200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d944e0-1ddf-472e-b1d0-e6e3465b21d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.892301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d944e0-1ddf-472e-b1d0-e6e3465b21d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.892687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d944e0-1ddf-472e-b1d0-e6e3465b21d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.893112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d944e0-1ddf-472e-b1d0-e6e3465b21d6 admin admin] PATH_INFO: `/v3/projects/487f45bf2d8a41539d326ba304e40cee/users/832e68600f8049a4a3ed90622a920ead/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.894699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1047/2102] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:46 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:46.895394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d944e0-1ddf-472e-b1d0-e6e3465b21d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487f45bf2d8a41539d326ba304e40cee, user_id=832e68600f8049a4a3ed90622a920ead, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.898213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d944e0-1ddf-472e-b1d0-e6e3465b21d6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.899043 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd9854-bf77-4354-8500-b4004b1b1988 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:46.908931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1056/2103] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:46 2022] PUT /identity/v3/projects/487f45bf2d8a41539d326ba304e40cee/users/832e68600f8049a4a3ed90622a920ead/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:46.909352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd9854-bf77-4354-8500-b4004b1b1988 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:46.919473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034829c-ace1-475b-9bba-ac35230cb7a9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.919830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034829c-ace1-475b-9bba-ac35230cb7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.920175 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034829c-ace1-475b-9bba-ac35230cb7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.951365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0034829c-ace1-475b-9bba-ac35230cb7a9 None None] MFA Rules not processed for user `832e68600f8049a4a3ed90622a920ead`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:46.953006 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0034829c-ace1-475b-9bba-ac35230cb7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:46.975569 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab32d0f-898a-4ac0-9712-feb18c009784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:46.976486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32d0f-898a-4ac0-9712-feb18c009784 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:46.976632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32d0f-898a-4ac0-9712-feb18c009784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:46.977059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32d0f-898a-4ac0-9712-feb18c009784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:46.977782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32d0f-898a-4ac0-9712-feb18c009784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:46.979414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32d0f-898a-4ac0-9712-feb18c009784 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:46.990772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1048/2104] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:46.996202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab32d0f-898a-4ac0-9712-feb18c009784 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.016186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab32d0f-898a-4ac0-9712-feb18c009784 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.020831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecde14-6665-423a-8ffe-6aa400c347f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.021589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecde14-6665-423a-8ffe-6aa400c347f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.021876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecde14-6665-423a-8ffe-6aa400c347f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.022280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecde14-6665-423a-8ffe-6aa400c347f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.023122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecde14-6665-423a-8ffe-6aa400c347f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.024979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecde14-6665-423a-8ffe-6aa400c347f0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.027002 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1057/2105] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:47.035194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1049/2106] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:47.038487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034829c-ace1-475b-9bba-ac35230cb7a9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.039130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecde14-6665-423a-8ffe-6aa400c347f0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.040145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0034829c-ace1-475b-9bba-ac35230cb7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:47.051812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecde14-6665-423a-8ffe-6aa400c347f0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.056953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f4eca-c550-40f3-83e8-a11f9856a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.057818 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f4eca-c550-40f3-83e8-a11f9856a184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.058123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f4eca-c550-40f3-83e8-a11f9856a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.058393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f4eca-c550-40f3-83e8-a11f9856a184 admin admin] PATH_INFO: `/v3/projects/46b1fbebed2e4271aad614ce99507195/users/2fed4f5407cf466cada435c02dc378fd/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.075906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f4eca-c550-40f3-83e8-a11f9856a184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b1fbebed2e4271aad614ce99507195, user_id=2fed4f5407cf466cada435c02dc378fd, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.076724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f4eca-c550-40f3-83e8-a11f9856a184 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.090651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1050/2107] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:47 2022] PUT /identity/v3/projects/46b1fbebed2e4271aad614ce99507195/users/2fed4f5407cf466cada435c02dc378fd/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:47.101695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a30466-d9b8-4d90-8e8e-f51f7ac4e9f0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.102263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a30466-d9b8-4d90-8e8e-f51f7ac4e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.102533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a30466-d9b8-4d90-8e8e-f51f7ac4e9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.111453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034829c-ace1-475b-9bba-ac35230cb7a9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.130248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e8a30466-d9b8-4d90-8e8e-f51f7ac4e9f0 None None] MFA Rules not processed for user `2fed4f5407cf466cada435c02dc378fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:47.131495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e8a30466-d9b8-4d90-8e8e-f51f7ac4e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:47.160539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638a8ac-8fb0-4855-b0f7-b6b9c0941977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.161184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638a8ac-8fb0-4855-b0f7-b6b9c0941977 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.161463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638a8ac-8fb0-4855-b0f7-b6b9c0941977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.161734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638a8ac-8fb0-4855-b0f7-b6b9c0941977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.201077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1051/2108] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:47.205534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a30466-d9b8-4d90-8e8e-f51f7ac4e9f0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.224569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638a8ac-8fb0-4855-b0f7-b6b9c0941977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.226690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638a8ac-8fb0-4855-b0f7-b6b9c0941977 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.237503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1058/2109] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:47.276153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a30466-d9b8-4d90-8e8e-f51f7ac4e9f0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.280967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de6df1-12bd-4a6f-bcfb-d7d33b39f7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.281705 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de6df1-12bd-4a6f-bcfb-d7d33b39f7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.282089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de6df1-12bd-4a6f-bcfb-d7d33b39f7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.282442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de6df1-12bd-4a6f-bcfb-d7d33b39f7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.283204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de6df1-12bd-4a6f-bcfb-d7d33b39f7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.285169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de6df1-12bd-4a6f-bcfb-d7d33b39f7e9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.319106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1052/2110] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:47 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:47.322862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638a8ac-8fb0-4855-b0f7-b6b9c0941977 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.334313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638a8ac-8fb0-4855-b0f7-b6b9c0941977 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.382283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de6df1-12bd-4a6f-bcfb-d7d33b39f7e9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.384198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-96de6df1-12bd-4a6f-bcfb-d7d33b39f7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:47.416952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cfc25-8658-4f2d-86c4-78044718617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.417634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cfc25-8658-4f2d-86c4-78044718617c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.417916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cfc25-8658-4f2d-86c4-78044718617c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.418208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cfc25-8658-4f2d-86c4-78044718617c admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.419053 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cfc25-8658-4f2d-86c4-78044718617c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.421279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cfc25-8658-4f2d-86c4-78044718617c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.447763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1059/2111] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:47 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:47.451224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cfc25-8658-4f2d-86c4-78044718617c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.462445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cfc25-8658-4f2d-86c4-78044718617c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.468219 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d8675-0c7d-49ce-944a-9a2dc91df0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.469109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d8675-0c7d-49ce-944a-9a2dc91df0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.469464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d8675-0c7d-49ce-944a-9a2dc91df0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.469802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d8675-0c7d-49ce-944a-9a2dc91df0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.471301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d8675-0c7d-49ce-944a-9a2dc91df0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.473121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d8675-0c7d-49ce-944a-9a2dc91df0fa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.483101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de6df1-12bd-4a6f-bcfb-d7d33b39f7e9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.485530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1060/2112] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:47.490582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d8675-0c7d-49ce-944a-9a2dc91df0fa admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.493387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263cc4b-db5f-417d-b398-690df89f6cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.494046 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263cc4b-db5f-417d-b398-690df89f6cfd service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.494331 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263cc4b-db5f-417d-b398-690df89f6cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.494636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263cc4b-db5f-417d-b398-690df89f6cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.496541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6263cc4b-db5f-417d-b398-690df89f6cfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:47.514328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d8675-0c7d-49ce-944a-9a2dc91df0fa admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.518788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf5afa-d056-42c4-9592-8aa8f2b3ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.519675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf5afa-d056-42c4-9592-8aa8f2b3ae94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.519957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf5afa-d056-42c4-9592-8aa8f2b3ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.520234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf5afa-d056-42c4-9592-8aa8f2b3ae94 admin admin] PATH_INFO: `/v3/projects/a508d3dbc9b94c889e01bef21405a49a/users/036bf28753df4903857e516abfabf690/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.537251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf5afa-d056-42c4-9592-8aa8f2b3ae94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a508d3dbc9b94c889e01bef21405a49a, user_id=036bf28753df4903857e516abfabf690, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.541956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf5afa-d056-42c4-9592-8aa8f2b3ae94 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.557266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1061/2113] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:47 2022] PUT /identity/v3/projects/a508d3dbc9b94c889e01bef21405a49a/users/036bf28753df4903857e516abfabf690/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:47.558278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf5afa-d056-42c4-9592-8aa8f2b3ae94 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.574584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263cc4b-db5f-417d-b398-690df89f6cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.576032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263cc4b-db5f-417d-b398-690df89f6cfd service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.586795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1053/2114] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:47.586959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263cc4b-db5f-417d-b398-690df89f6cfd service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.597982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263cc4b-db5f-417d-b398-690df89f6cfd service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.621217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf5afa-d056-42c4-9592-8aa8f2b3ae94 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.626374 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b29e25-0ae8-4487-b3ec-f9a08c2fce93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.627068 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b29e25-0ae8-4487-b3ec-f9a08c2fce93 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.627353 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b29e25-0ae8-4487-b3ec-f9a08c2fce93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.627633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b29e25-0ae8-4487-b3ec-f9a08c2fce93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.629609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-67b29e25-0ae8-4487-b3ec-f9a08c2fce93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:47.658796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c58d49-a631-4a66-af48-28634279d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.659469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c58d49-a631-4a66-af48-28634279d07a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.659783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c58d49-a631-4a66-af48-28634279d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.660061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c58d49-a631-4a66-af48-28634279d07a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.660892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c58d49-a631-4a66-af48-28634279d07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.662560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c58d49-a631-4a66-af48-28634279d07a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.674132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1054/2115] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:47.678218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c58d49-a631-4a66-af48-28634279d07a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.700005 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b29e25-0ae8-4487-b3ec-f9a08c2fce93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.701457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b29e25-0ae8-4487-b3ec-f9a08c2fce93 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.708494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c58d49-a631-4a66-af48-28634279d07a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.712576 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1062/2116] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:47.730770 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9153a-7883-495e-a60d-9d051f1c460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.740284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9153a-7883-495e-a60d-9d051f1c460a admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.741911 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9153a-7883-495e-a60d-9d051f1c460a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.742238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9153a-7883-495e-a60d-9d051f1c460a admin admin] PATH_INFO: `/v3/projects/a508d3dbc9b94c889e01bef21405a49a/users/036bf28753df4903857e516abfabf690/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.745243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9153a-7883-495e-a60d-9d051f1c460a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a508d3dbc9b94c889e01bef21405a49a, user_id=036bf28753df4903857e516abfabf690, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.748046 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9153a-7883-495e-a60d-9d051f1c460a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.758750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1055/2117] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:47 2022] PUT /identity/v3/projects/a508d3dbc9b94c889e01bef21405a49a/users/036bf28753df4903857e516abfabf690/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:47.768979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2326c9c-4aba-4aa3-8983-45181e9567a0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.769434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2326c9c-4aba-4aa3-8983-45181e9567a0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.769912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2326c9c-4aba-4aa3-8983-45181e9567a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.799795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c2326c9c-4aba-4aa3-8983-45181e9567a0 None None] MFA Rules not processed for user `036bf28753df4903857e516abfabf690`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:47.801196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c2326c9c-4aba-4aa3-8983-45181e9567a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:47.881332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1063/2118] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:47.895563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9153a-7883-495e-a60d-9d051f1c460a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:47.958956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9153a-7883-495e-a60d-9d051f1c460a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:47.965040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73056655-ba82-48ea-b0e2-d584e0be9174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:47.965968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73056655-ba82-48ea-b0e2-d584e0be9174 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:47.966537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73056655-ba82-48ea-b0e2-d584e0be9174 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:47.967053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73056655-ba82-48ea-b0e2-d584e0be9174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:47.977450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73056655-ba82-48ea-b0e2-d584e0be9174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:47.978941 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73056655-ba82-48ea-b0e2-d584e0be9174 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:47.989239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1056/2119] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:48.334900 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2326c9c-4aba-4aa3-8983-45181e9567a0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:48.345147 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2326c9c-4aba-4aa3-8983-45181e9567a0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:48.348686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900db62-4b34-4924-8110-799617234004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:48.350602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900db62-4b34-4924-8110-799617234004 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:48.351083 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900db62-4b34-4924-8110-799617234004 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:48.351427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900db62-4b34-4924-8110-799617234004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:48.354110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d900db62-4b34-4924-8110-799617234004 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:48.425029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73056655-ba82-48ea-b0e2-d584e0be9174 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:48.429633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900db62-4b34-4924-8110-799617234004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:48.432224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900db62-4b34-4924-8110-799617234004 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:48.444211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1064/2120] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:48.503951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73056655-ba82-48ea-b0e2-d584e0be9174 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:48.509498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:48.510986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:48.511272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:48.511518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] PATH_INFO: `/v3/users/2fed4f5407cf466cada435c02dc378fd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:48.513287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fed4f5407cf466cada435c02dc378fd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:48.515005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:48.571420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fed4f5407cf466cada435c02dc378fd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:48.582807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fed4f5407cf466cada435c02dc378fd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:48.583479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fed4f5407cf466cada435c02dc378fd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:48.584079 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fed4f5407cf466cada435c02dc378fd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:48.591078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fed4f5407cf466cada435c02dc378fd'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:48.604623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1057/2121] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:48 2022] DELETE /identity/v3/users/2fed4f5407cf466cada435c02dc378fd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:48.609178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18af7a8-cabc-435b-9590-90bd2d933d94 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:48.609469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18af7a8-cabc-435b-9590-90bd2d933d94 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:48.609748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18af7a8-cabc-435b-9590-90bd2d933d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:48.628711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e18af7a8-cabc-435b-9590-90bd2d933d94 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:48.629955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e18af7a8-cabc-435b-9590-90bd2d933d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:48.692337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1065/2122] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:48.702707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:48.704126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:48.774195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee6b10-4f74-4448-aca9-8219f3b82e65 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:48.778024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5823e3-9670-48c7-a809-38f11c2615d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:48.778679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5823e3-9670-48c7-a809-38f11c2615d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:48.779057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5823e3-9670-48c7-a809-38f11c2615d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:48.779224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5823e3-9670-48c7-a809-38f11c2615d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:48.800163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5823e3-9670-48c7-a809-38f11c2615d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:48.801893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5823e3-9670-48c7-a809-38f11c2615d9 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:48.813487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1058/2123] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:49.093543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18af7a8-cabc-435b-9590-90bd2d933d94 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:49.095414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e18af7a8-cabc-435b-9590-90bd2d933d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:49.108826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18af7a8-cabc-435b-9590-90bd2d933d94 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:49.114177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:49.115035 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:49.115325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:49.115582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] PATH_INFO: `/v3/projects/46b1fbebed2e4271aad614ce99507195` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:49.117417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b1fbebed2e4271aad614ce99507195)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:49.119483 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:49.169779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b1fbebed2e4271aad614ce99507195', 'request_id': 'req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.176010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b1fbebed2e4271aad614ce99507195', 'request_id': 'req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.184720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b1fbebed2e4271aad614ce99507195', 'request_id': 'req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.197104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] The token cache is being invalidate because project 46b1fbebed2e4271aad614ce99507195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:49.197465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.198224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.200349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1066/2124] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:49 2022] DELETE /identity/v3/projects/46b1fbebed2e4271aad614ce99507195 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:49.204140 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5823e3-9670-48c7-a809-38f11c2615d9 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:49.215533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5823e3-9670-48c7-a809-38f11c2615d9 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:49.282390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:49.283296 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:49.283602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:49.283878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] PATH_INFO: `/v3/users/036bf28753df4903857e516abfabf690` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:49.285094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=036bf28753df4903857e516abfabf690)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:49.287092 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:49.334185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036bf28753df4903857e516abfabf690'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.346527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036bf28753df4903857e516abfabf690'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.347354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036bf28753df4903857e516abfabf690'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.348163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036bf28753df4903857e516abfabf690'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.356052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-749cbc40-75c5-4e54-8ffd-feaa8c16ee7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036bf28753df4903857e516abfabf690'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.369949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1059/2125] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:49 2022] DELETE /identity/v3/users/036bf28753df4903857e516abfabf690 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:49.635238 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:49.637350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:49.663879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2a2f2-40ba-4f7a-a72c-4924ce12abce admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:49.724586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:49.725524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:49.726543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:49.727080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] PATH_INFO: `/v3/projects/a508d3dbc9b94c889e01bef21405a49a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:49.728486 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a508d3dbc9b94c889e01bef21405a49a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:49.730628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:49.777992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a508d3dbc9b94c889e01bef21405a49a', 'request_id': 'req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.784174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a508d3dbc9b94c889e01bef21405a49a', 'request_id': 'req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.791566 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a508d3dbc9b94c889e01bef21405a49a', 'request_id': 'req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.802469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] The token cache is being invalidate because project a508d3dbc9b94c889e01bef21405a49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:49.802762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.803534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac9d3df2-d43a-4d2e-8c5c-1f8ecd21090c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:49.805339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1067/2126] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:49 2022] DELETE /identity/v3/projects/a508d3dbc9b94c889e01bef21405a49a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:49.812706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62409bf0-eadc-419f-bf05-6d261727491e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:49.813150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62409bf0-eadc-419f-bf05-6d261727491e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:49.813310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62409bf0-eadc-419f-bf05-6d261727491e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:49.855537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-62409bf0-eadc-419f-bf05-6d261727491e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:49.856782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-62409bf0-eadc-419f-bf05-6d261727491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:49.962088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1060/2127] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:49.972559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf9ae-d8d7-4a52-aca2-7fd238719ac7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:49.973439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf9ae-d8d7-4a52-aca2-7fd238719ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:49.973911 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf9ae-d8d7-4a52-aca2-7fd238719ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:49.999754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-492bf9ae-d8d7-4a52-aca2-7fd238719ac7 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:50.001050 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-492bf9ae-d8d7-4a52-aca2-7fd238719ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:50.013215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1068/2128] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:50.014523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62409bf0-eadc-419f-bf05-6d261727491e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.024219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62409bf0-eadc-419f-bf05-6d261727491e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.028824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbdf70-77ac-4c09-9727-a06cdf696482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.029502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbdf70-77ac-4c09-9727-a06cdf696482 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.030957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbdf70-77ac-4c09-9727-a06cdf696482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.030957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbdf70-77ac-4c09-9727-a06cdf696482 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.030957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbdf70-77ac-4c09-9727-a06cdf696482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:50.031255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbdf70-77ac-4c09-9727-a06cdf696482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.032674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbdf70-77ac-4c09-9727-a06cdf696482 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.048374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1061/2129] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:43:50.049480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bf9ae-d8d7-4a52-aca2-7fd238719ac7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.058878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bf9ae-d8d7-4a52-aca2-7fd238719ac7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.063502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e47c28-29ff-412d-be4d-83d4e58ca8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.064142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e47c28-29ff-412d-be4d-83d4e58ca8fd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.064418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e47c28-29ff-412d-be4d-83d4e58ca8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.064686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e47c28-29ff-412d-be4d-83d4e58ca8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.065375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e47c28-29ff-412d-be4d-83d4e58ca8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.067273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e47c28-29ff-412d-be4d-83d4e58ca8fd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.095300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1069/2130] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:50 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:50.096444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbdf70-77ac-4c09-9727-a06cdf696482 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.107430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbdf70-77ac-4c09-9727-a06cdf696482 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.174471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adb9e1-ff3f-4b11-a181-211b7852487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.175147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adb9e1-ff3f-4b11-a181-211b7852487a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.175430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adb9e1-ff3f-4b11-a181-211b7852487a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.175756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adb9e1-ff3f-4b11-a181-211b7852487a admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.176457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adb9e1-ff3f-4b11-a181-211b7852487a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.179342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adb9e1-ff3f-4b11-a181-211b7852487a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.200746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1062/2131] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:50 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:50.204841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e47c28-29ff-412d-be4d-83d4e58ca8fd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.215882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e47c28-29ff-412d-be4d-83d4e58ca8fd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.222129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3b07f-567a-4eec-8211-fbcaee0809ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.222129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3b07f-567a-4eec-8211-fbcaee0809ed admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.222129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3b07f-567a-4eec-8211-fbcaee0809ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.222448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3b07f-567a-4eec-8211-fbcaee0809ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.222969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3b07f-567a-4eec-8211-fbcaee0809ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.224615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3b07f-567a-4eec-8211-fbcaee0809ed admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.236821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1070/2132] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:50.240579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adb9e1-ff3f-4b11-a181-211b7852487a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.252832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adb9e1-ff3f-4b11-a181-211b7852487a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.260650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a216282-fab4-4414-962a-fa68c177cf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.261736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a216282-fab4-4414-962a-fa68c177cf04 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.262445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a216282-fab4-4414-962a-fa68c177cf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.262725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a216282-fab4-4414-962a-fa68c177cf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.263891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a216282-fab4-4414-962a-fa68c177cf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.266221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a216282-fab4-4414-962a-fa68c177cf04 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.281835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1063/2133] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:50.284643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3b07f-567a-4eec-8211-fbcaee0809ed admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.296321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3b07f-567a-4eec-8211-fbcaee0809ed admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.302197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e5587-f133-4be9-845a-a85253621ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.303070 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e5587-f133-4be9-845a-a85253621ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.303355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e5587-f133-4be9-845a-a85253621ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.303700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e5587-f133-4be9-845a-a85253621ec7 admin admin] PATH_INFO: `/v3/projects/49bc814d594245749541677fe5fefacf/users/c192f4a8a38b4218b5bf04d0d86b1d1c/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.323780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e5587-f133-4be9-845a-a85253621ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bc814d594245749541677fe5fefacf, user_id=c192f4a8a38b4218b5bf04d0d86b1d1c, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.327005 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e5587-f133-4be9-845a-a85253621ec7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.350167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1071/2134] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:50 2022] PUT /identity/v3/projects/49bc814d594245749541677fe5fefacf/users/c192f4a8a38b4218b5bf04d0d86b1d1c/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:50.361652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012ffc6-cec4-4185-b2ea-408e83b129fd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.361944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012ffc6-cec4-4185-b2ea-408e83b129fd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.362262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012ffc6-cec4-4185-b2ea-408e83b129fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.393401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2012ffc6-cec4-4185-b2ea-408e83b129fd None None] MFA Rules not processed for user `c192f4a8a38b4218b5bf04d0d86b1d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:50.394671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2012ffc6-cec4-4185-b2ea-408e83b129fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:50.427106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e5587-f133-4be9-845a-a85253621ec7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.428408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff0e5587-f133-4be9-845a-a85253621ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:50.487317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1064/2135] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:50.499401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012ffc6-cec4-4185-b2ea-408e83b129fd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.500843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2012ffc6-cec4-4185-b2ea-408e83b129fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:50.504296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e5587-f133-4be9-845a-a85253621ec7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.510083 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.511144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.511428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.511703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] PATH_INFO: `/v3/users/e9dd7c10420c4d908309dc9f45b090b7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.512992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9dd7c10420c4d908309dc9f45b090b7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.514986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.568218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012ffc6-cec4-4185-b2ea-408e83b129fd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.571490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9dd7c10420c4d908309dc9f45b090b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.572709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecb961-6889-4104-b0b8-86da8f362763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.573374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecb961-6889-4104-b0b8-86da8f362763 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.573659 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecb961-6889-4104-b0b8-86da8f362763 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.573935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecb961-6889-4104-b0b8-86da8f362763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.584716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecb961-6889-4104-b0b8-86da8f362763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.584949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9dd7c10420c4d908309dc9f45b090b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.586160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9dd7c10420c4d908309dc9f45b090b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.586836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecb961-6889-4104-b0b8-86da8f362763 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.595425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9dd7c10420c4d908309dc9f45b090b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.597177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1065/2136] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:50.604847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9dd7c10420c4d908309dc9f45b090b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.611689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1072/2137] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:50 2022] DELETE /identity/v3/users/e9dd7c10420c4d908309dc9f45b090b7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:50.617408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52a79-cdf0-493c-883d-def45d3a4098 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.617408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52a79-cdf0-493c-883d-def45d3a4098 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.617408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52a79-cdf0-493c-883d-def45d3a4098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.636983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-75a52a79-cdf0-493c-883d-def45d3a4098 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:50.638024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-75a52a79-cdf0-493c-883d-def45d3a4098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:50.709186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1066/2138] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:50.725304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.727701 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:50.770558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52a79-cdf0-493c-883d-def45d3a4098 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:50.773540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-75a52a79-cdf0-493c-883d-def45d3a4098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:50.795100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52a79-cdf0-493c-883d-def45d3a4098 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.809504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.810253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbb87e-f6e8-40a8-86a2-ce036ebe9552 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:50.810634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.810910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.811539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] PATH_INFO: `/v3/users/df32bb55daa64c5396bd96a86f19b5d8` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.814798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8cef-459b-46a2-a543-f7a3891cf054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:50.815614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8cef-459b-46a2-a543-f7a3891cf054 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:50.815727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df32bb55daa64c5396bd96a86f19b5d8)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.816465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8cef-459b-46a2-a543-f7a3891cf054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:50.816951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8cef-459b-46a2-a543-f7a3891cf054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:50.817725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.838805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd8cef-459b-46a2-a543-f7a3891cf054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:50.841487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd8cef-459b-46a2-a543-f7a3891cf054 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:50.858222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1073/2139] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:50.892075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df32bb55daa64c5396bd96a86f19b5d8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.901933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df32bb55daa64c5396bd96a86f19b5d8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.902772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df32bb55daa64c5396bd96a86f19b5d8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.903786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df32bb55daa64c5396bd96a86f19b5d8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.923185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df32bb55daa64c5396bd96a86f19b5d8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:50.938767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1067/2140] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:50 2022] DELETE /identity/v3/users/df32bb55daa64c5396bd96a86f19b5d8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:51.206733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8cef-459b-46a2-a543-f7a3891cf054 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.221666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8cef-459b-46a2-a543-f7a3891cf054 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.281274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.283150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:51.325504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.326420 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.326705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.326980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] PATH_INFO: `/v3/projects/5e120255943e4fecadc7d4a2a9188f9d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.328183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e120255943e4fecadc7d4a2a9188f9d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.330112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.368102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9282043-3a88-4bfc-8033-2fc0dc299bb7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.373548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.374714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.374714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.375008 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] PATH_INFO: `/v3/projects/c9ce4a215ef14683ab8fc38726ecef35` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.376198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ce4a215ef14683ab8fc38726ecef35)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.378197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.389339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e120255943e4fecadc7d4a2a9188f9d', 'request_id': 'req-a03a47d5-f764-4bf6-874f-6769961da032'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.395920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e120255943e4fecadc7d4a2a9188f9d', 'request_id': 'req-a03a47d5-f764-4bf6-874f-6769961da032'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.404070 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e120255943e4fecadc7d4a2a9188f9d', 'request_id': 'req-a03a47d5-f764-4bf6-874f-6769961da032'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.416298 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] The token cache is being invalidate because project 5e120255943e4fecadc7d4a2a9188f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:51.416686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.417413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a03a47d5-f764-4bf6-874f-6769961da032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.419054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1074/2141] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:51 2022] DELETE /identity/v3/projects/5e120255943e4fecadc7d4a2a9188f9d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:51.425014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55172e1-1763-4b42-a9b6-c737c7012296 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.425322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55172e1-1763-4b42-a9b6-c737c7012296 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.425623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55172e1-1763-4b42-a9b6-c737c7012296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.428204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ce4a215ef14683ab8fc38726ecef35', 'request_id': 'req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.434968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ce4a215ef14683ab8fc38726ecef35', 'request_id': 'req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.442817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ce4a215ef14683ab8fc38726ecef35', 'request_id': 'req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.445336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d55172e1-1763-4b42-a9b6-c737c7012296 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:51.446591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d55172e1-1763-4b42-a9b6-c737c7012296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:51.453913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] The token cache is being invalidate because project c9ce4a215ef14683ab8fc38726ecef35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:51.454308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.455033 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.456743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1068/2142] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:51 2022] DELETE /identity/v3/projects/c9ce4a215ef14683ab8fc38726ecef35 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:51.460555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.461877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:51.509262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1075/2143] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:51.517563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ffd9-4cb2-4c63-a80a-12c413eb7e33 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.517844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ffd9-4cb2-4c63-a80a-12c413eb7e33 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.518159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ffd9-4cb2-4c63-a80a-12c413eb7e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.525181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a83cba-7c59-408e-bbe2-7d9bbc9a1c97 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.529945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.530845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.531122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.531397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] PATH_INFO: `/v3/users/832e68600f8049a4a3ed90622a920ead` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.532616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] RBAC: Authorizing `identity:delete_user(user_id=832e68600f8049a4a3ed90622a920ead)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.534582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.536391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dbb3ffd9-4cb2-4c63-a80a-12c413eb7e33 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:51.537605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dbb3ffd9-4cb2-4c63-a80a-12c413eb7e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:51.545942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1076/2144] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:51.549966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3ffd9-4cb2-4c63-a80a-12c413eb7e33 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.560482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3ffd9-4cb2-4c63-a80a-12c413eb7e33 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.568544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e1d4-d759-4fb3-9698-3c2665849748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.569762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e1d4-d759-4fb3-9698-3c2665849748 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.570348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e1d4-d759-4fb3-9698-3c2665849748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.570870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e1d4-d759-4fb3-9698-3c2665849748 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.572406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e1d4-d759-4fb3-9698-3c2665849748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:51.572921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e1d4-d759-4fb3-9698-3c2665849748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.576479 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e1d4-d759-4fb3-9698-3c2665849748 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.592222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832e68600f8049a4a3ed90622a920ead'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.594516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1077/2145] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:43:51.598861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e1d4-d759-4fb3-9698-3c2665849748 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.609773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e1d4-d759-4fb3-9698-3c2665849748 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.609920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832e68600f8049a4a3ed90622a920ead'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.610572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832e68600f8049a4a3ed90622a920ead'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.611245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832e68600f8049a4a3ed90622a920ead'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.614454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8670fac-dcd6-4bde-b2de-c4f4ad2a1cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.615100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8670fac-dcd6-4bde-b2de-c4f4ad2a1cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.615406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8670fac-dcd6-4bde-b2de-c4f4ad2a1cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.615683 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8670fac-dcd6-4bde-b2de-c4f4ad2a1cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.616382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8670fac-dcd6-4bde-b2de-c4f4ad2a1cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.617836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832e68600f8049a4a3ed90622a920ead'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:51.618308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8670fac-dcd6-4bde-b2de-c4f4ad2a1cbd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.631958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1069/2146] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:51 2022] DELETE /identity/v3/users/832e68600f8049a4a3ed90622a920ead => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:51.649828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1078/2147] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:51 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:51.651291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.652812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:51.720706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063efc67-a76f-4165-b2f0-8c425f32252d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.778996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d7b1a-38f3-45fe-a858-4057bcdafa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.779609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d7b1a-38f3-45fe-a858-4057bcdafa85 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.779900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d7b1a-38f3-45fe-a858-4057bcdafa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.780186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d7b1a-38f3-45fe-a858-4057bcdafa85 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.780951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d7b1a-38f3-45fe-a858-4057bcdafa85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.783150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d7b1a-38f3-45fe-a858-4057bcdafa85 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.815902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1070/2148] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:51 2022] POST /identity/v3/users => generated 282 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:51.817067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8670fac-dcd6-4bde-b2de-c4f4ad2a1cbd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.832388 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8670fac-dcd6-4bde-b2de-c4f4ad2a1cbd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.840909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32986eba-166f-4904-ac4e-246a60f069b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.841720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986eba-166f-4904-ac4e-246a60f069b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.842059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986eba-166f-4904-ac4e-246a60f069b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.842383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986eba-166f-4904-ac4e-246a60f069b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.843124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32986eba-166f-4904-ac4e-246a60f069b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.844732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32986eba-166f-4904-ac4e-246a60f069b6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.856154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1079/2149] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:51.860146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d7b1a-38f3-45fe-a858-4057bcdafa85 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.871385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d7b1a-38f3-45fe-a858-4057bcdafa85 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.876154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c5365-9131-4b17-a457-de13f0818cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.876874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c5365-9131-4b17-a457-de13f0818cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.877111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c5365-9131-4b17-a457-de13f0818cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.877392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c5365-9131-4b17-a457-de13f0818cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.878150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c5365-9131-4b17-a457-de13f0818cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.879788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c5365-9131-4b17-a457-de13f0818cb5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.890805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1071/2150] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:43:51.896201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32986eba-166f-4904-ac4e-246a60f069b6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.909363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32986eba-166f-4904-ac4e-246a60f069b6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.915493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38e972-5417-44c5-a7f0-89ef6af2dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.916481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38e972-5417-44c5-a7f0-89ef6af2dc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.916831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38e972-5417-44c5-a7f0-89ef6af2dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.917197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38e972-5417-44c5-a7f0-89ef6af2dc4c admin admin] PATH_INFO: `/v3/projects/59cafc7aa7bf40c5a22e0451269de3ae/users/5aa24e19b77f4007a6e0abe7e3defcab/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.931765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c5365-9131-4b17-a457-de13f0818cb5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:51.934383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-881c5365-9131-4b17-a457-de13f0818cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:51.952598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c5365-9131-4b17-a457-de13f0818cb5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:51.958533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38e972-5417-44c5-a7f0-89ef6af2dc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cafc7aa7bf40c5a22e0451269de3ae, user_id=5aa24e19b77f4007a6e0abe7e3defcab, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.961311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38e972-5417-44c5-a7f0-89ef6af2dc4c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.965668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:51.966622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:51.966941 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:51.967216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] PATH_INFO: `/v3/projects/487f45bf2d8a41539d326ba304e40cee` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:51.970593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] RBAC: Authorizing `identity:delete_project(project_id=487f45bf2d8a41539d326ba304e40cee)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:51.972583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:51.999856 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1080/2151] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:51 2022] PUT /identity/v3/projects/59cafc7aa7bf40c5a22e0451269de3ae/users/5aa24e19b77f4007a6e0abe7e3defcab/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:52.011301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebd4ca-baf0-482b-bb4b-8ad2767aa127 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.011602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebd4ca-baf0-482b-bb4b-8ad2767aa127 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.012368 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebd4ca-baf0-482b-bb4b-8ad2767aa127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.043843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d3ebd4ca-baf0-482b-bb4b-8ad2767aa127 None None] MFA Rules not processed for user `5aa24e19b77f4007a6e0abe7e3defcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:52.045730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d3ebd4ca-baf0-482b-bb4b-8ad2767aa127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.077866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487f45bf2d8a41539d326ba304e40cee', 'request_id': 'req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.087391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487f45bf2d8a41539d326ba304e40cee', 'request_id': 'req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.107665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487f45bf2d8a41539d326ba304e40cee', 'request_id': 'req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.121300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] The token cache is being invalidate because project 487f45bf2d8a41539d326ba304e40cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:52.121571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.122236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a30c4b9b-ea45-4d9a-b9d4-5312e26fc64a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.126563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1072/2152] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:51 2022] DELETE /identity/v3/projects/487f45bf2d8a41539d326ba304e40cee => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:52.128360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ad0d-5811-4ca2-84cf-0b82532546bc None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.128843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ad0d-5811-4ca2-84cf-0b82532546bc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.129187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ad0d-5811-4ca2-84cf-0b82532546bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.138651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1081/2153] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:52.149204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4da2ad0d-5811-4ca2-84cf-0b82532546bc None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:52.149926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebd4ca-baf0-482b-bb4b-8ad2767aa127 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.150135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4da2ad0d-5811-4ca2-84cf-0b82532546bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.151342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d3ebd4ca-baf0-482b-bb4b-8ad2767aa127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.213048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1073/2154] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:52.219243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebd4ca-baf0-482b-bb4b-8ad2767aa127 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.221123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccac9a-37c9-4e05-af34-c1851e6665ac None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.221408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccac9a-37c9-4e05-af34-c1851e6665ac None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.221682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccac9a-37c9-4e05-af34-c1851e6665ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.243529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-40ccac9a-37c9-4e05-af34-c1851e6665ac None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:52.244737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-40ccac9a-37c9-4e05-af34-c1851e6665ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.256622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1074/2155] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:52.262824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccac9a-37c9-4e05-af34-c1851e6665ac None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.272833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccac9a-37c9-4e05-af34-c1851e6665ac None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.277686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf76518-c572-47d3-aadb-e8043b28ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.278388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76518-c572-47d3-aadb-e8043b28ee02 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.278670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76518-c572-47d3-aadb-e8043b28ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.278943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76518-c572-47d3-aadb-e8043b28ee02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.280716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf76518-c572-47d3-aadb-e8043b28ee02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:52.280716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf76518-c572-47d3-aadb-e8043b28ee02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.281746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf76518-c572-47d3-aadb-e8043b28ee02 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.283494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d46c4-e835-4ef4-b7a8-61fab17f1bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.284184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d46c4-e835-4ef4-b7a8-61fab17f1bae service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.284491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d46c4-e835-4ef4-b7a8-61fab17f1bae service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.284787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d46c4-e835-4ef4-b7a8-61fab17f1bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.287170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0f4d46c4-e835-4ef4-b7a8-61fab17f1bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.294656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1075/2156] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:43:52.298965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf76518-c572-47d3-aadb-e8043b28ee02 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.309097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf76518-c572-47d3-aadb-e8043b28ee02 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.314547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fb32d-0e77-4f80-9864-520e12290efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.315732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fb32d-0e77-4f80-9864-520e12290efc admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.316086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fb32d-0e77-4f80-9864-520e12290efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.316427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fb32d-0e77-4f80-9864-520e12290efc admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.317636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fb32d-0e77-4f80-9864-520e12290efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.320169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fb32d-0e77-4f80-9864-520e12290efc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.346242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1076/2157] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:52 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:52.350185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fb32d-0e77-4f80-9864-520e12290efc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.356122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d46c4-e835-4ef4-b7a8-61fab17f1bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.357674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d46c4-e835-4ef4-b7a8-61fab17f1bae service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.374135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1082/2158] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:52.412072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fb32d-0e77-4f80-9864-520e12290efc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.418617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627894ca-f943-4735-83a4-dbb694a6412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.419288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627894ca-f943-4735-83a4-dbb694a6412b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.419568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627894ca-f943-4735-83a4-dbb694a6412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.419843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627894ca-f943-4735-83a4-dbb694a6412b admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.420559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627894ca-f943-4735-83a4-dbb694a6412b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.422575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627894ca-f943-4735-83a4-dbb694a6412b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.450840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1077/2159] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:52 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:52.451953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d46c4-e835-4ef4-b7a8-61fab17f1bae service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.466332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d46c4-e835-4ef4-b7a8-61fab17f1bae service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.471746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c385be7-3823-429c-bcd9-35be065f32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.473538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c385be7-3823-429c-bcd9-35be065f32ab admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.474175 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c385be7-3823-429c-bcd9-35be065f32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.474402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c385be7-3823-429c-bcd9-35be065f32ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.475312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c385be7-3823-429c-bcd9-35be065f32ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.477956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c385be7-3823-429c-bcd9-35be065f32ab admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.490503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1083/2160] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:52.494728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627894ca-f943-4735-83a4-dbb694a6412b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.500583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c385be7-3823-429c-bcd9-35be065f32ab admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.502613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c385be7-3823-429c-bcd9-35be065f32ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.508380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627894ca-f943-4735-83a4-dbb694a6412b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.514143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c8cf2-3b06-4cbc-af4b-0111ef19ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.515072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8cf2-3b06-4cbc-af4b-0111ef19ba5c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.515460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8cf2-3b06-4cbc-af4b-0111ef19ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.515816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8cf2-3b06-4cbc-af4b-0111ef19ba5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.516631 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c8cf2-3b06-4cbc-af4b-0111ef19ba5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.519060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c8cf2-3b06-4cbc-af4b-0111ef19ba5c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.519315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c385be7-3823-429c-bcd9-35be065f32ab admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.526205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.528511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.528805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.529208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] PATH_INFO: `/v3/users/15b8a672c393405b824d42f0ec7f3d70` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.532007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b8a672c393405b824d42f0ec7f3d70)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.534039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.534757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1078/2161] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:52.539428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c8cf2-3b06-4cbc-af4b-0111ef19ba5c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.550512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c8cf2-3b06-4cbc-af4b-0111ef19ba5c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.556977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b837fc2-2526-4729-9cc3-ec9099996413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.557967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837fc2-2526-4729-9cc3-ec9099996413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.558552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837fc2-2526-4729-9cc3-ec9099996413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.558743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837fc2-2526-4729-9cc3-ec9099996413 admin admin] PATH_INFO: `/v3/projects/ef7fd0c9860a4a8abc6efcc89a711c30/users/4bb7b86edd30469f9addc5abc62c0f84/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.578974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b837fc2-2526-4729-9cc3-ec9099996413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7fd0c9860a4a8abc6efcc89a711c30, user_id=4bb7b86edd30469f9addc5abc62c0f84, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.582521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b837fc2-2526-4729-9cc3-ec9099996413 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.596425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1079/2162] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:52 2022] PUT /identity/v3/projects/ef7fd0c9860a4a8abc6efcc89a711c30/users/4bb7b86edd30469f9addc5abc62c0f84/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:52.598440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b8a672c393405b824d42f0ec7f3d70'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.608242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66880d-7f06-4aee-8aff-b9bce6318216 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.608532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66880d-7f06-4aee-8aff-b9bce6318216 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.608780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66880d-7f06-4aee-8aff-b9bce6318216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.616177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b8a672c393405b824d42f0ec7f3d70'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.617293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b8a672c393405b824d42f0ec7f3d70'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.625897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b8a672c393405b824d42f0ec7f3d70'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.637236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18c2adcb-c421-4482-a127-e0c40f9adde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b8a672c393405b824d42f0ec7f3d70'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:52.639376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1d66880d-7f06-4aee-8aff-b9bce6318216 None None] MFA Rules not processed for user `4bb7b86edd30469f9addc5abc62c0f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:52.640762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1d66880d-7f06-4aee-8aff-b9bce6318216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.643883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1084/2163] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:52 2022] DELETE /identity/v3/users/15b8a672c393405b824d42f0ec7f3d70 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:52.648986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02759-06fc-4846-ba3e-db3ef539d097 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.649275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02759-06fc-4846-ba3e-db3ef539d097 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.649549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02759-06fc-4846-ba3e-db3ef539d097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.667251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5fb02759-06fc-4846-ba3e-db3ef539d097 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:52.668614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5fb02759-06fc-4846-ba3e-db3ef539d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.736849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1080/2164] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:52.743863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1085/2165] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:52.749115 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66880d-7f06-4aee-8aff-b9bce6318216 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.751039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1d66880d-7f06-4aee-8aff-b9bce6318216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.759389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02759-06fc-4846-ba3e-db3ef539d097 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.763451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5fb02759-06fc-4846-ba3e-db3ef539d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.814011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66880d-7f06-4aee-8aff-b9bce6318216 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.827704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02759-06fc-4846-ba3e-db3ef539d097 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.831579 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ccb7f-93ac-42ba-aa63-3d806f885174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.832218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ccb7f-93ac-42ba-aa63-3d806f885174 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.832500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ccb7f-93ac-42ba-aa63-3d806f885174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.832776 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ccb7f-93ac-42ba-aa63-3d806f885174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.842947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ccb7f-93ac-42ba-aa63-3d806f885174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.844438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ccb7f-93ac-42ba-aa63-3d806f885174 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.855519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1086/2166] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:52.870036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21056ba3-cf73-41de-a06a-70abdf79e84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.870731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21056ba3-cf73-41de-a06a-70abdf79e84d service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.871036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21056ba3-cf73-41de-a06a-70abdf79e84d service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.871337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21056ba3-cf73-41de-a06a-70abdf79e84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.936174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21056ba3-cf73-41de-a06a-70abdf79e84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.937620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21056ba3-cf73-41de-a06a-70abdf79e84d service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:52.947024 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1081/2167] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:52.967649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ccb7f-93ac-42ba-aa63-3d806f885174 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:52.969220 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1b5ccb7f-93ac-42ba-aa63-3d806f885174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:52.982571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ccb7f-93ac-42ba-aa63-3d806f885174 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:52.987401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:52.988261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:52.988546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:52.988821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] PATH_INFO: `/v3/users/4bb7b86edd30469f9addc5abc62c0f84` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:52.990043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb7b86edd30469f9addc5abc62c0f84)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:52.992611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:53.046026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb7b86edd30469f9addc5abc62c0f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.066684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb7b86edd30469f9addc5abc62c0f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.067450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb7b86edd30469f9addc5abc62c0f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.076007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb7b86edd30469f9addc5abc62c0f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.086039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb7b86edd30469f9addc5abc62c0f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.094644 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1087/2168] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:52 2022] DELETE /identity/v3/users/4bb7b86edd30469f9addc5abc62c0f84 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:53.099282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39fb8-cc87-4bdf-bd1a-8c3076e31e7b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.099571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39fb8-cc87-4bdf-bd1a-8c3076e31e7b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.099880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39fb8-cc87-4bdf-bd1a-8c3076e31e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.118164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5ce39fb8-cc87-4bdf-bd1a-8c3076e31e7b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:53.119361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5ce39fb8-cc87-4bdf-bd1a-8c3076e31e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.163128 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:53.165330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.210898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1082/2169] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:43:53.222823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39fb8-cc87-4bdf-bd1a-8c3076e31e7b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:53.224261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5ce39fb8-cc87-4bdf-bd1a-8c3076e31e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.245745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c72a87-1593-48be-9e48-b23795f28d63 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:53.252772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:53.253682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.253985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.254276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] PATH_INFO: `/v3/projects/91dd406c96be45e7b8899425b9db96e2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.256022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91dd406c96be45e7b8899425b9db96e2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:53.257967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:53.293524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39fb8-cc87-4bdf-bd1a-8c3076e31e7b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:53.297470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b2e0b-a5cc-4264-be1a-64c5dab20461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:53.298355 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b2e0b-a5cc-4264-be1a-64c5dab20461 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.298640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b2e0b-a5cc-4264-be1a-64c5dab20461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.299101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b2e0b-a5cc-4264-be1a-64c5dab20461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.310590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b2e0b-a5cc-4264-be1a-64c5dab20461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:53.312027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b2e0b-a5cc-4264-be1a-64c5dab20461 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:53.315323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91dd406c96be45e7b8899425b9db96e2', 'request_id': 'req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.322312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91dd406c96be45e7b8899425b9db96e2', 'request_id': 'req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.326243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1083/2170] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:53.332705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91dd406c96be45e7b8899425b9db96e2', 'request_id': 'req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.354196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b2e0b-a5cc-4264-be1a-64c5dab20461 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:53.356155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-620b2e0b-a5cc-4264-be1a-64c5dab20461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.359411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] The token cache is being invalidate because project 91dd406c96be45e7b8899425b9db96e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:53.359968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.361155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.362986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1088/2171] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:53 2022] DELETE /identity/v3/projects/91dd406c96be45e7b8899425b9db96e2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:53.368069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:53.369959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.372458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b2e0b-a5cc-4264-be1a-64c5dab20461 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:53.438603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:53.439663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.439953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.440232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] PATH_INFO: `/v3/users/c192f4a8a38b4218b5bf04d0d86b1d1c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.441496 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c192f4a8a38b4218b5bf04d0d86b1d1c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:53.443592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:53.446615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8668e0-7a2e-4dd3-a73d-7a4c4f6f1da8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:53.452865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:53.453755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.454093 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.454363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] PATH_INFO: `/v3/users/fda25346e0af4052b1d886f91e3ddb7c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.455737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda25346e0af4052b1d886f91e3ddb7c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:53.460018 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:53.506516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c192f4a8a38b4218b5bf04d0d86b1d1c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.521701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c192f4a8a38b4218b5bf04d0d86b1d1c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.525261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c192f4a8a38b4218b5bf04d0d86b1d1c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.525930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c192f4a8a38b4218b5bf04d0d86b1d1c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.527584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda25346e0af4052b1d886f91e3ddb7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.533261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-90a8d3ba-dd85-4951-9c8a-d4e04a616edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c192f4a8a38b4218b5bf04d0d86b1d1c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.541798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda25346e0af4052b1d886f91e3ddb7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.542600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda25346e0af4052b1d886f91e3ddb7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.550225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda25346e0af4052b1d886f91e3ddb7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.551384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1084/2172] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:53 2022] DELETE /identity/v3/users/c192f4a8a38b4218b5bf04d0d86b1d1c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:53.555490 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3a66-aa1d-4909-8e33-7aae41bb13c9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.555782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3a66-aa1d-4909-8e33-7aae41bb13c9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.556060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3a66-aa1d-4909-8e33-7aae41bb13c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.561321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda25346e0af4052b1d886f91e3ddb7c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.568244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1089/2173] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:53 2022] DELETE /identity/v3/users/fda25346e0af4052b1d886f91e3ddb7c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:53.578996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-620a3a66-aa1d-4909-8e33-7aae41bb13c9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:53.580185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-620a3a66-aa1d-4909-8e33-7aae41bb13c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.623037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:53.624422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.665262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1085/2174] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:53.678397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3a66-aa1d-4909-8e33-7aae41bb13c9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:53.680556 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-620a3a66-aa1d-4909-8e33-7aae41bb13c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.716372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bec6c-ad70-455b-a6d9-5fc5cf8c10ee admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:53.721852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:53.723763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.724074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.724421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] PATH_INFO: `/v3/projects/ef7fd0c9860a4a8abc6efcc89a711c30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.726594 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7fd0c9860a4a8abc6efcc89a711c30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:53.730343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:53.744132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3a66-aa1d-4909-8e33-7aae41bb13c9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:53.747954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67980783-5adc-400f-aec2-f53f480c8ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:53.748597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980783-5adc-400f-aec2-f53f480c8ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.748877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980783-5adc-400f-aec2-f53f480c8ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.749150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980783-5adc-400f-aec2-f53f480c8ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.758877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67980783-5adc-400f-aec2-f53f480c8ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:53.760432 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67980783-5adc-400f-aec2-f53f480c8ab5 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:53.780552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1086/2175] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:53.785457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7fd0c9860a4a8abc6efcc89a711c30', 'request_id': 'req-2ab52383-0358-42d3-9508-58321d25a84c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.792550 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7fd0c9860a4a8abc6efcc89a711c30', 'request_id': 'req-2ab52383-0358-42d3-9508-58321d25a84c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.801896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7fd0c9860a4a8abc6efcc89a711c30', 'request_id': 'req-2ab52383-0358-42d3-9508-58321d25a84c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.813793 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] The token cache is being invalidate because project ef7fd0c9860a4a8abc6efcc89a711c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:53.814401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.815160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2ab52383-0358-42d3-9508-58321d25a84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:53.817001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1090/2176] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:53 2022] DELETE /identity/v3/projects/ef7fd0c9860a4a8abc6efcc89a711c30 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:53.821904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c0947-f21d-4a5f-ab29-02a0dbaadfa6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.822287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c0947-f21d-4a5f-ab29-02a0dbaadfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.822622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c0947-f21d-4a5f-ab29-02a0dbaadfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.840972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6b1c0947-f21d-4a5f-ab29-02a0dbaadfa6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:53.842280 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6b1c0947-f21d-4a5f-ab29-02a0dbaadfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.903254 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1087/2177] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:53.911039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bdf59-0da4-4927-ac68-252e30875225 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.911535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bdf59-0da4-4927-ac68-252e30875225 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.911667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bdf59-0da4-4927-ac68-252e30875225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.931437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8c2bdf59-0da4-4927-ac68-252e30875225 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:53.932720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8c2bdf59-0da4-4927-ac68-252e30875225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.941063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1091/2178] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:53.946219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c0947-f21d-4a5f-ab29-02a0dbaadfa6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:53.958613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c0947-f21d-4a5f-ab29-02a0dbaadfa6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:53.958843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bdf59-0da4-4927-ac68-252e30875225 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:53.960424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8c2bdf59-0da4-4927-ac68-252e30875225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:53.963955 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a21242-3197-482d-937a-a861c89776d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:53.964622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a21242-3197-482d-937a-a861c89776d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.964903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a21242-3197-482d-937a-a861c89776d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.965178 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a21242-3197-482d-937a-a861c89776d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.965913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a21242-3197-482d-937a-a861c89776d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:43:53.966249 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a21242-3197-482d-937a-a861c89776d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:53.967882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a21242-3197-482d-937a-a861c89776d8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:53.973315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bdf59-0da4-4927-ac68-252e30875225 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:53.979712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:53.980573 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:53.980855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:53.981118 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] PATH_INFO: `/v3/projects/2838f4fbc16541b6ab73bf807dc58b10` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:53.984840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1088/2179] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:43:53.989440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a21242-3197-482d-937a-a861c89776d8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:53.993829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2838f4fbc16541b6ab73bf807dc58b10)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:53.996901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.002241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a21242-3197-482d-937a-a861c89776d8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:54.010818 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be656b14-e389-4264-9574-65169297abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:54.011567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be656b14-e389-4264-9574-65169297abda admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.012698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be656b14-e389-4264-9574-65169297abda admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.013056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be656b14-e389-4264-9574-65169297abda admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.014523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be656b14-e389-4264-9574-65169297abda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:54.017135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be656b14-e389-4264-9574-65169297abda admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.049032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1089/2180] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:43:53 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:43:54.053239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2838f4fbc16541b6ab73bf807dc58b10', 'request_id': 'req-55181e04-8d0d-4b2b-8157-c5c358923ed4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.053393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be656b14-e389-4264-9574-65169297abda admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:54.061901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2838f4fbc16541b6ab73bf807dc58b10', 'request_id': 'req-55181e04-8d0d-4b2b-8157-c5c358923ed4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.071097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2838f4fbc16541b6ab73bf807dc58b10', 'request_id': 'req-55181e04-8d0d-4b2b-8157-c5c358923ed4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.083542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] The token cache is being invalidate because project 2838f4fbc16541b6ab73bf807dc58b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:54.083933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.084751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.089862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1092/2181] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:53 2022] DELETE /identity/v3/projects/2838f4fbc16541b6ab73bf807dc58b10 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:54.090744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:54.092104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:54.135066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be656b14-e389-4264-9574-65169297abda admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:54.148197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8237e-ce65-42ef-9d8b-88ba3b064bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:54.148197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8237e-ce65-42ef-9d8b-88ba3b064bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.148197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8237e-ce65-42ef-9d8b-88ba3b064bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.148197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8237e-ce65-42ef-9d8b-88ba3b064bbb admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.148588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8237e-ce65-42ef-9d8b-88ba3b064bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:54.150723 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8237e-ce65-42ef-9d8b-88ba3b064bbb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.176329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1090/2182] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:43:54 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:43:54.176329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8237e-ce65-42ef-9d8b-88ba3b064bbb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:54.176329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-17a8237e-ce65-42ef-9d8b-88ba3b064bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:54.189409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8237e-ce65-42ef-9d8b-88ba3b064bbb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:54.194075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:54.195487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.195768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.196040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] PATH_INFO: `/v3/projects/49bc814d594245749541677fe5fefacf` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.197224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bc814d594245749541677fe5fefacf)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:54.198813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55181e04-8d0d-4b2b-8157-c5c358923ed4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:54.199426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.203687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:54.204562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.204842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.205115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] PATH_INFO: `/v3/users/780050dddfcc43bca4a57c1bbed22364` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.206540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] RBAC: Authorizing `identity:delete_user(user_id=780050dddfcc43bca4a57c1bbed22364)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:54.208485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.252085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bc814d594245749541677fe5fefacf', 'request_id': 'req-7eda36e9-340d-444b-87cd-172d20ab66ee'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.259375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bc814d594245749541677fe5fefacf', 'request_id': 'req-7eda36e9-340d-444b-87cd-172d20ab66ee'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.262756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780050dddfcc43bca4a57c1bbed22364'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.266586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bc814d594245749541677fe5fefacf', 'request_id': 'req-7eda36e9-340d-444b-87cd-172d20ab66ee'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.276538 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780050dddfcc43bca4a57c1bbed22364'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.277218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780050dddfcc43bca4a57c1bbed22364'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.277526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] The token cache is being invalidate because project 49bc814d594245749541677fe5fefacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:54.277807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.278460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.280006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1091/2183] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:54 2022] DELETE /identity/v3/projects/49bc814d594245749541677fe5fefacf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:54.280751 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:54.282060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:54.292044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780050dddfcc43bca4a57c1bbed22364'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.301585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780050dddfcc43bca4a57c1bbed22364'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.308846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1093/2184] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:43:54 2022] DELETE /identity/v3/users/780050dddfcc43bca4a57c1bbed22364 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:54.370534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda36e9-340d-444b-87cd-172d20ab66ee admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:54.456145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad9e7-0285-44e3-b8d0-e4a374a70820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:54.456837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad9e7-0285-44e3-b8d0-e4a374a70820 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.457113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad9e7-0285-44e3-b8d0-e4a374a70820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.457384 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad9e7-0285-44e3-b8d0-e4a374a70820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.458147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ad9e7-0285-44e3-b8d0-e4a374a70820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:54.459901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ad9e7-0285-44e3-b8d0-e4a374a70820 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.473493 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1092/2185] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:54.475369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:54.477503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:54.493863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe882-51bd-44ed-aa59-67d7e7f9772f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:54.498883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08072faa-8acd-4b11-8e95-4978671d0d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:54.500104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08072faa-8acd-4b11-8e95-4978671d0d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.500396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08072faa-8acd-4b11-8e95-4978671d0d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.500669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08072faa-8acd-4b11-8e95-4978671d0d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.501396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08072faa-8acd-4b11-8e95-4978671d0d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:54.503096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08072faa-8acd-4b11-8e95-4978671d0d88 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.518802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1094/2186] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:43:54.520396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad9e7-0285-44e3-b8d0-e4a374a70820 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:54.532986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad9e7-0285-44e3-b8d0-e4a374a70820 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:54.538304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f963d4-b0ad-4d34-ae46-e5cca3ba4230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:54.539432 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f963d4-b0ad-4d34-ae46-e5cca3ba4230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.539432 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f963d4-b0ad-4d34-ae46-e5cca3ba4230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.539634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f963d4-b0ad-4d34-ae46-e5cca3ba4230 admin admin] PATH_INFO: `/v3/projects/cac36e5078db4023a88b7720e409780b/users/8f0f8ee6e0d24c749a405850ba15f560/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.559473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f963d4-b0ad-4d34-ae46-e5cca3ba4230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac36e5078db4023a88b7720e409780b, user_id=8f0f8ee6e0d24c749a405850ba15f560, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:54.563477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f963d4-b0ad-4d34-ae46-e5cca3ba4230 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.580917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1093/2187] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:43:54 2022] PUT /identity/v3/projects/cac36e5078db4023a88b7720e409780b/users/8f0f8ee6e0d24c749a405850ba15f560/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:43:54.586496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc83ae-e43f-4909-b445-5e421c4683ac None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.586659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc83ae-e43f-4909-b445-5e421c4683ac None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.587179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc83ae-e43f-4909-b445-5e421c4683ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.610574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-27fc83ae-e43f-4909-b445-5e421c4683ac None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:54.611963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-27fc83ae-e43f-4909-b445-5e421c4683ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:54.663339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f963d4-b0ad-4d34-ae46-e5cca3ba4230 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:54.665213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a1f963d4-b0ad-4d34-ae46-e5cca3ba4230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:54.692741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1095/2188] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:54.699537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc83ae-e43f-4909-b445-5e421c4683ac None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:54.701101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-27fc83ae-e43f-4909-b445-5e421c4683ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:54.736601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f963d4-b0ad-4d34-ae46-e5cca3ba4230 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:54.741866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:54.742748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.743030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.743306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] PATH_INFO: `/v3/projects/1057cfe014824408b20fb07a551db1f6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.744487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1057cfe014824408b20fb07a551db1f6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:54.746440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.758804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc83ae-e43f-4909-b445-5e421c4683ac None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:54.762411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab14073-9742-4164-a868-c68a01483c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:54.763045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab14073-9742-4164-a868-c68a01483c8e service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:54.763325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab14073-9742-4164-a868-c68a01483c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:54.763594 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab14073-9742-4164-a868-c68a01483c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:54.772553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab14073-9742-4164-a868-c68a01483c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:54.774168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab14073-9742-4164-a868-c68a01483c8e service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:54.783483 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1096/2189] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:43:54.794881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1057cfe014824408b20fb07a551db1f6', 'request_id': 'req-ad14a39a-88a8-4c9e-bc66-736a37faee57'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.801674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1057cfe014824408b20fb07a551db1f6', 'request_id': 'req-ad14a39a-88a8-4c9e-bc66-736a37faee57'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.810635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1057cfe014824408b20fb07a551db1f6', 'request_id': 'req-ad14a39a-88a8-4c9e-bc66-736a37faee57'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.821416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] The token cache is being invalidate because project 1057cfe014824408b20fb07a551db1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:43:54.821756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.822442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:43:54.824208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1094/2190] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:43:54 2022] DELETE /identity/v3/projects/1057cfe014824408b20fb07a551db1f6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:43:55.454512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b1d81-d959-43e6-aad3-8e766e6467d5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:55.454997 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b1d81-d959-43e6-aad3-8e766e6467d5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:55.455098 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b1d81-d959-43e6-aad3-8e766e6467d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:55.483859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-db0b1d81-d959-43e6-aad3-8e766e6467d5 None None] MFA Rules not processed for user `8f0f8ee6e0d24c749a405850ba15f560`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:55.485205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-db0b1d81-d959-43e6-aad3-8e766e6467d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:55.551727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1097/2191] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:43:55.562471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:43:55.563912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:55.619491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a39a-88a8-4c9e-bc66-736a37faee57 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:43:55.623425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45fb0d-2c86-45fc-83d7-6004464297f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:43:55.623894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45fb0d-2c86-45fc-83d7-6004464297f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:55.624715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45fb0d-2c86-45fc-83d7-6004464297f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:55.624715 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45fb0d-2c86-45fc-83d7-6004464297f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:55.633202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45fb0d-2c86-45fc-83d7-6004464297f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:43:55.634836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45fb0d-2c86-45fc-83d7-6004464297f6 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:43:55.643663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1095/2192] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:43:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:43:58.032088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3647b2-00dc-4c90-817c-c0b20b2f8ba2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:43:58.032649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3647b2-00dc-4c90-817c-c0b20b2f8ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:43:58.032649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3647b2-00dc-4c90-817c-c0b20b2f8ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:43:58.050034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7e3647b2-00dc-4c90-817c-c0b20b2f8ba2 None None] MFA Rules not processed for user `8f0f8ee6e0d24c749a405850ba15f560`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:43:58.051259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7e3647b2-00dc-4c90-817c-c0b20b2f8ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:43:58.058408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1098/2193] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:02.965614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45fb0d-2c86-45fc-83d7-6004464297f6 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:02.967248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5e45fb0d-2c86-45fc-83d7-6004464297f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:03.030905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45fb0d-2c86-45fc-83d7-6004464297f6 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:03.035418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:03.036317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:03.036699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:03.036980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] PATH_INFO: `/v3/users/5aa24e19b77f4007a6e0abe7e3defcab` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:03.038703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa24e19b77f4007a6e0abe7e3defcab)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:03.040633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:03.085201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa24e19b77f4007a6e0abe7e3defcab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.096808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa24e19b77f4007a6e0abe7e3defcab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.097466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa24e19b77f4007a6e0abe7e3defcab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.098104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa24e19b77f4007a6e0abe7e3defcab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.105614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa24e19b77f4007a6e0abe7e3defcab'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.123023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1096/2194] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:44:02 2022] DELETE /identity/v3/users/5aa24e19b77f4007a6e0abe7e3defcab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:03.128126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe7357-dee9-40ec-aa11-cdaa1bea8469 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:03.128588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe7357-dee9-40ec-aa11-cdaa1bea8469 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:03.128703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe7357-dee9-40ec-aa11-cdaa1bea8469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:03.145721 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-afbe7357-dee9-40ec-aa11-cdaa1bea8469 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:03.146957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-afbe7357-dee9-40ec-aa11-cdaa1bea8469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:03.205078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1099/2195] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:03.214838 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:03.216221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:03.272458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8f4b5-c5f9-4a95-a0ae-a8e67647c8cf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:03.276172 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4b4e3-7ac9-43a5-af1d-19f929889704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:03.276823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b4e3-7ac9-43a5-af1d-19f929889704 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:03.277112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b4e3-7ac9-43a5-af1d-19f929889704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:03.277390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b4e3-7ac9-43a5-af1d-19f929889704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:03.286581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4b4e3-7ac9-43a5-af1d-19f929889704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:03.288533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4b4e3-7ac9-43a5-af1d-19f929889704 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:03.298170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1097/2196] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:03.622057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe7357-dee9-40ec-aa11-cdaa1bea8469 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:03.623623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-afbe7357-dee9-40ec-aa11-cdaa1bea8469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:03.637343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe7357-dee9-40ec-aa11-cdaa1bea8469 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:03.642505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:03.643362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:03.643646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:03.643935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] PATH_INFO: `/v3/projects/59cafc7aa7bf40c5a22e0451269de3ae` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:03.645318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cafc7aa7bf40c5a22e0451269de3ae)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:03.647046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:03.693046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cafc7aa7bf40c5a22e0451269de3ae', 'request_id': 'req-6e2f1775-ff49-4714-b63f-4cc237226b04'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.699565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cafc7aa7bf40c5a22e0451269de3ae', 'request_id': 'req-6e2f1775-ff49-4714-b63f-4cc237226b04'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.706597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cafc7aa7bf40c5a22e0451269de3ae', 'request_id': 'req-6e2f1775-ff49-4714-b63f-4cc237226b04'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.718704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] The token cache is being invalidate because project 59cafc7aa7bf40c5a22e0451269de3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:44:03.718987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.719598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6e2f1775-ff49-4714-b63f-4cc237226b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:03.721122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1100/2197] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:44:03 2022] DELETE /identity/v3/projects/59cafc7aa7bf40c5a22e0451269de3ae => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:03.726648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f0b07-9f51-4675-8a20-5d56d87af74b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:03.727195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f0b07-9f51-4675-8a20-5d56d87af74b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:03.727473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f0b07-9f51-4675-8a20-5d56d87af74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:03.745216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-334f0b07-9f51-4675-8a20-5d56d87af74b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:03.746450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-334f0b07-9f51-4675-8a20-5d56d87af74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:03.802960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1098/2198] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:03.811296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde68c3-5045-4bb9-af8f-6954ccc63419 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:03.811613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde68c3-5045-4bb9-af8f-6954ccc63419 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:03.811894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde68c3-5045-4bb9-af8f-6954ccc63419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:03.829533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1dde68c3-5045-4bb9-af8f-6954ccc63419 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:03.830750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1dde68c3-5045-4bb9-af8f-6954ccc63419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:03.838587 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1101/2199] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:03.842579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f0b07-9f51-4675-8a20-5d56d87af74b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:03.852806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f0b07-9f51-4675-8a20-5d56d87af74b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:03.857408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f7263-ffbd-4619-85ef-2a762dde0739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:03.858087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f7263-ffbd-4619-85ef-2a762dde0739 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:03.858373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f7263-ffbd-4619-85ef-2a762dde0739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:03.858653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f7263-ffbd-4619-85ef-2a762dde0739 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:03.859371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f7263-ffbd-4619-85ef-2a762dde0739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:44:03.859674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f7263-ffbd-4619-85ef-2a762dde0739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:03.861267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f7263-ffbd-4619-85ef-2a762dde0739 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:03.874107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1099/2200] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:44:03.878682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde68c3-5045-4bb9-af8f-6954ccc63419 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:03.892401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde68c3-5045-4bb9-af8f-6954ccc63419 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:03.899140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13830c03-40c7-44d1-a829-22f4f76b6932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:03.900104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13830c03-40c7-44d1-a829-22f4f76b6932 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:03.900531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13830c03-40c7-44d1-a829-22f4f76b6932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:03.900949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13830c03-40c7-44d1-a829-22f4f76b6932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:03.902061 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13830c03-40c7-44d1-a829-22f4f76b6932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:03.904381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13830c03-40c7-44d1-a829-22f4f76b6932 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:03.930068 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1102/2201] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:44:03 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:44:03.934245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f7263-ffbd-4619-85ef-2a762dde0739 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:03.944109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f7263-ffbd-4619-85ef-2a762dde0739 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:03.999787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fd3f6-230b-4cf7-a680-c5fec1734c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.000493 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fd3f6-230b-4cf7-a680-c5fec1734c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.000772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fd3f6-230b-4cf7-a680-c5fec1734c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.001164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fd3f6-230b-4cf7-a680-c5fec1734c57 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.001848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fd3f6-230b-4cf7-a680-c5fec1734c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.004414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fd3f6-230b-4cf7-a680-c5fec1734c57 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.023186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1100/2202] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:44:03 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:04.026891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13830c03-40c7-44d1-a829-22f4f76b6932 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.036866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13830c03-40c7-44d1-a829-22f4f76b6932 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.041947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e951a4-87b8-4814-a503-53b0707c5a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.042633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e951a4-87b8-4814-a503-53b0707c5a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.042915 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e951a4-87b8-4814-a503-53b0707c5a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.043183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e951a4-87b8-4814-a503-53b0707c5a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.043902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e951a4-87b8-4814-a503-53b0707c5a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.045485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e951a4-87b8-4814-a503-53b0707c5a32 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.056481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1103/2203] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:04.060392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fd3f6-230b-4cf7-a680-c5fec1734c57 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.070329 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fd3f6-230b-4cf7-a680-c5fec1734c57 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.075023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863ab40-6255-42bf-9d87-6a709920b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.075667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ab40-6255-42bf-9d87-6a709920b337 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.075954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ab40-6255-42bf-9d87-6a709920b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.076227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ab40-6255-42bf-9d87-6a709920b337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.077099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863ab40-6255-42bf-9d87-6a709920b337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.078660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863ab40-6255-42bf-9d87-6a709920b337 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.089175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1101/2204] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:04.093140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e951a4-87b8-4814-a503-53b0707c5a32 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.104334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e951a4-87b8-4814-a503-53b0707c5a32 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.108880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee931-8911-46a5-9fa1-235223bd5bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.109749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee931-8911-46a5-9fa1-235223bd5bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.110077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee931-8911-46a5-9fa1-235223bd5bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.110384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee931-8911-46a5-9fa1-235223bd5bdc admin admin] PATH_INFO: `/v3/projects/e9994fd409c34aeca50155a77ed1f20e/users/801163e9229047b3a52e2494e998bd82/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.124503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ee931-8911-46a5-9fa1-235223bd5bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9994fd409c34aeca50155a77ed1f20e, user_id=801163e9229047b3a52e2494e998bd82, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.127154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ee931-8911-46a5-9fa1-235223bd5bdc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.140251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1104/2205] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:04 2022] PUT /identity/v3/projects/e9994fd409c34aeca50155a77ed1f20e/users/801163e9229047b3a52e2494e998bd82/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:04.153664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97f8cc-754b-41b7-9efc-ff8ad2bb7197 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.153953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97f8cc-754b-41b7-9efc-ff8ad2bb7197 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.154288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97f8cc-754b-41b7-9efc-ff8ad2bb7197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.180357 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bd97f8cc-754b-41b7-9efc-ff8ad2bb7197 None None] MFA Rules not processed for user `801163e9229047b3a52e2494e998bd82`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:04.181568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bd97f8cc-754b-41b7-9efc-ff8ad2bb7197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:04.247341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1102/2206] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:04.252394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee931-8911-46a5-9fa1-235223bd5bdc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.314623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee931-8911-46a5-9fa1-235223bd5bdc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.319876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0cce1-8f80-4101-be9d-5cf4937a0401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.320514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0cce1-8f80-4101-be9d-5cf4937a0401 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.320796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0cce1-8f80-4101-be9d-5cf4937a0401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.321067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0cce1-8f80-4101-be9d-5cf4937a0401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.321742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0cce1-8f80-4101-be9d-5cf4937a0401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.323669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0cce1-8f80-4101-be9d-5cf4937a0401 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.347053 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1105/2207] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:44:04 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:04.351026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97f8cc-754b-41b7-9efc-ff8ad2bb7197 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.361644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97f8cc-754b-41b7-9efc-ff8ad2bb7197 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.415094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40216b8-c36c-42a6-854c-997d8e8d8130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.415693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40216b8-c36c-42a6-854c-997d8e8d8130 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.415963 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40216b8-c36c-42a6-854c-997d8e8d8130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.416239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40216b8-c36c-42a6-854c-997d8e8d8130 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.416925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40216b8-c36c-42a6-854c-997d8e8d8130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.418891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40216b8-c36c-42a6-854c-997d8e8d8130 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.436670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1103/2208] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:44:04 2022] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:04.440561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0cce1-8f80-4101-be9d-5cf4937a0401 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.450482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0cce1-8f80-4101-be9d-5cf4937a0401 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.455228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605972b-1460-4ec0-a6ab-3ffb9037f295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.455885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605972b-1460-4ec0-a6ab-3ffb9037f295 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.456308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605972b-1460-4ec0-a6ab-3ffb9037f295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.456963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605972b-1460-4ec0-a6ab-3ffb9037f295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.457398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605972b-1460-4ec0-a6ab-3ffb9037f295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.458959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605972b-1460-4ec0-a6ab-3ffb9037f295 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.471162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1106/2209] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:04.475954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40216b8-c36c-42a6-854c-997d8e8d8130 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.486318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40216b8-c36c-42a6-854c-997d8e8d8130 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.491833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d5ad-00d1-462e-9c17-6f030c1e7bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.492906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d5ad-00d1-462e-9c17-6f030c1e7bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.493455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d5ad-00d1-462e-9c17-6f030c1e7bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.493713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d5ad-00d1-462e-9c17-6f030c1e7bb4 admin admin] PATH_INFO: `/v3/projects/8d8aec0e8efe44b69947cbf1d1dc32f3/users/568ebba5a46d4fa0947fe60c0a3ce7da/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.508983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245d5ad-00d1-462e-9c17-6f030c1e7bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8aec0e8efe44b69947cbf1d1dc32f3, user_id=568ebba5a46d4fa0947fe60c0a3ce7da, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.511872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245d5ad-00d1-462e-9c17-6f030c1e7bb4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.525951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1104/2210] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:04 2022] PUT /identity/v3/projects/8d8aec0e8efe44b69947cbf1d1dc32f3/users/568ebba5a46d4fa0947fe60c0a3ce7da/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:04.529922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605972b-1460-4ec0-a6ab-3ffb9037f295 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.540571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605972b-1460-4ec0-a6ab-3ffb9037f295 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.597077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50710729-a58f-4ca7-b94a-26a0474f20ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.597750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50710729-a58f-4ca7-b94a-26a0474f20ca admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.598125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50710729-a58f-4ca7-b94a-26a0474f20ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.598347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50710729-a58f-4ca7-b94a-26a0474f20ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.599076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50710729-a58f-4ca7-b94a-26a0474f20ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.600676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50710729-a58f-4ca7-b94a-26a0474f20ca admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.613885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1107/2211] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:04.615065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d5ad-00d1-462e-9c17-6f030c1e7bb4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.625011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d5ad-00d1-462e-9c17-6f030c1e7bb4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.629465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97967c92-fcb9-4b8f-8eb9-e92ea2b589ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.630363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97967c92-fcb9-4b8f-8eb9-e92ea2b589ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.630642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97967c92-fcb9-4b8f-8eb9-e92ea2b589ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.630915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97967c92-fcb9-4b8f-8eb9-e92ea2b589ba admin admin] PATH_INFO: `/v3/projects/8d8aec0e8efe44b69947cbf1d1dc32f3/users/568ebba5a46d4fa0947fe60c0a3ce7da/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.633360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97967c92-fcb9-4b8f-8eb9-e92ea2b589ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8aec0e8efe44b69947cbf1d1dc32f3, user_id=568ebba5a46d4fa0947fe60c0a3ce7da, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.636000 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97967c92-fcb9-4b8f-8eb9-e92ea2b589ba admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.645624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1105/2212] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:04 2022] PUT /identity/v3/projects/8d8aec0e8efe44b69947cbf1d1dc32f3/users/568ebba5a46d4fa0947fe60c0a3ce7da/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:44:04.656666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4d4ba-f7d7-444e-bdf3-121fea5f6fcd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.656957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4d4ba-f7d7-444e-bdf3-121fea5f6fcd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.657232 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4d4ba-f7d7-444e-bdf3-121fea5f6fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.684735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-02e4d4ba-f7d7-444e-bdf3-121fea5f6fcd None None] MFA Rules not processed for user `568ebba5a46d4fa0947fe60c0a3ce7da`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:04.685709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-02e4d4ba-f7d7-444e-bdf3-121fea5f6fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:04.753550 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1108/2213] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:04.764864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97967c92-fcb9-4b8f-8eb9-e92ea2b589ba admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:04.766578 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-97967c92-fcb9-4b8f-8eb9-e92ea2b589ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:04.822226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97967c92-fcb9-4b8f-8eb9-e92ea2b589ba admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:04.825821 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca279850-4ea5-4bcd-85fa-1b0f9db1dba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:04.826474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca279850-4ea5-4bcd-85fa-1b0f9db1dba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:04.826758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca279850-4ea5-4bcd-85fa-1b0f9db1dba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:04.827029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca279850-4ea5-4bcd-85fa-1b0f9db1dba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:04.836374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca279850-4ea5-4bcd-85fa-1b0f9db1dba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:04.837801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca279850-4ea5-4bcd-85fa-1b0f9db1dba9 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:04.847177 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1106/2214] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:04 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:05.230830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4d4ba-f7d7-444e-bdf3-121fea5f6fcd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:05.290242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4d4ba-f7d7-444e-bdf3-121fea5f6fcd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:05.294890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:05.295749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:05.296029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:05.296297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] PATH_INFO: `/v3/users/801163e9229047b3a52e2494e998bd82` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:05.297467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=801163e9229047b3a52e2494e998bd82)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:05.299474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:05.342967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801163e9229047b3a52e2494e998bd82'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.354636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801163e9229047b3a52e2494e998bd82'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.355310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801163e9229047b3a52e2494e998bd82'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.361632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801163e9229047b3a52e2494e998bd82'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.369660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801163e9229047b3a52e2494e998bd82'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.376054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1109/2215] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:44:05 2022] DELETE /identity/v3/users/801163e9229047b3a52e2494e998bd82 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:05.380714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585ed4-dcf9-4edb-93ef-0ef02c81321f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:05.381191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585ed4-dcf9-4edb-93ef-0ef02c81321f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:05.381285 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585ed4-dcf9-4edb-93ef-0ef02c81321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:05.397626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-67585ed4-dcf9-4edb-93ef-0ef02c81321f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:05.398834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-67585ed4-dcf9-4edb-93ef-0ef02c81321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:05.453506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1107/2216] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:05.463005 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:05.464397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:05.519089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670f759-69a4-4228-ba1e-931aa3e1ec20 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:05.522716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301e186-bf5b-4918-9e56-848588297640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:05.523344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301e186-bf5b-4918-9e56-848588297640 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:05.523622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301e186-bf5b-4918-9e56-848588297640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:05.523892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301e186-bf5b-4918-9e56-848588297640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:05.532586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301e186-bf5b-4918-9e56-848588297640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:05.533987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301e186-bf5b-4918-9e56-848588297640 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:05.543652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1110/2217] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:05.825525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67585ed4-dcf9-4edb-93ef-0ef02c81321f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:05.828016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-67585ed4-dcf9-4edb-93ef-0ef02c81321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:05.843102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67585ed4-dcf9-4edb-93ef-0ef02c81321f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:05.848256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:05.849266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:05.849775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:05.850086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] PATH_INFO: `/v3/projects/e9994fd409c34aeca50155a77ed1f20e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:05.854427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9994fd409c34aeca50155a77ed1f20e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:05.858038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:05.906541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9994fd409c34aeca50155a77ed1f20e', 'request_id': 'req-231a78fb-4231-4abb-a164-2dd43a764f37'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.912584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9994fd409c34aeca50155a77ed1f20e', 'request_id': 'req-231a78fb-4231-4abb-a164-2dd43a764f37'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.920289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9994fd409c34aeca50155a77ed1f20e', 'request_id': 'req-231a78fb-4231-4abb-a164-2dd43a764f37'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.931462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] The token cache is being invalidate because project e9994fd409c34aeca50155a77ed1f20e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:44:05.931799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.932435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:05.934036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1108/2218] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:44:05 2022] DELETE /identity/v3/projects/e9994fd409c34aeca50155a77ed1f20e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:05.938180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301e186-bf5b-4918-9e56-848588297640 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:05.949023 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301e186-bf5b-4918-9e56-848588297640 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:06.009841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:06.011409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.011690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.011964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] PATH_INFO: `/v3/users/568ebba5a46d4fa0947fe60c0a3ce7da` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.013170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=568ebba5a46d4fa0947fe60c0a3ce7da)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:06.015379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:06.059009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568ebba5a46d4fa0947fe60c0a3ce7da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.070399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568ebba5a46d4fa0947fe60c0a3ce7da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.071064 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568ebba5a46d4fa0947fe60c0a3ce7da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.077465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568ebba5a46d4fa0947fe60c0a3ce7da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.084278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b1fda6b-8de2-4f4a-8b9f-13047f51a36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568ebba5a46d4fa0947fe60c0a3ce7da'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.090194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1111/2219] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:44:05 2022] DELETE /identity/v3/users/568ebba5a46d4fa0947fe60c0a3ce7da => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:06.349151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:06.351323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:06.366300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a78fb-4231-4abb-a164-2dd43a764f37 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:06.424251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:06.425100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.425376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.425643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] PATH_INFO: `/v3/projects/8d8aec0e8efe44b69947cbf1d1dc32f3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.426853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8aec0e8efe44b69947cbf1d1dc32f3)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:06.428886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:06.473244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8aec0e8efe44b69947cbf1d1dc32f3', 'request_id': 'req-975879da-d392-4424-a375-f3f9e03b9408'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.480098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8aec0e8efe44b69947cbf1d1dc32f3', 'request_id': 'req-975879da-d392-4424-a375-f3f9e03b9408'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.487108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8aec0e8efe44b69947cbf1d1dc32f3', 'request_id': 'req-975879da-d392-4424-a375-f3f9e03b9408'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.497599 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] The token cache is being invalidate because project 8d8aec0e8efe44b69947cbf1d1dc32f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:44:06.497912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.498571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-975879da-d392-4424-a375-f3f9e03b9408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:06.500133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1109/2220] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:44:06 2022] DELETE /identity/v3/projects/8d8aec0e8efe44b69947cbf1d1dc32f3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:06.505241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6df59-1245-4516-ad0d-4f1017c7e5ab None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.505711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6df59-1245-4516-ad0d-4f1017c7e5ab None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.505799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6df59-1245-4516-ad0d-4f1017c7e5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.525287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b0b6df59-1245-4516-ad0d-4f1017c7e5ab None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:06.526444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b0b6df59-1245-4516-ad0d-4f1017c7e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:06.586469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1112/2221] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:06.594032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8757-d3b6-4039-a398-22bf96a3636a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.594325 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8757-d3b6-4039-a398-22bf96a3636a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.594788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8757-d3b6-4039-a398-22bf96a3636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.612566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a40c8757-d3b6-4039-a398-22bf96a3636a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:06.613762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a40c8757-d3b6-4039-a398-22bf96a3636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:06.622367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1110/2222] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:06.626544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6df59-1245-4516-ad0d-4f1017c7e5ab None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:06.636591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6df59-1245-4516-ad0d-4f1017c7e5ab None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:06.641162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb3beb-b674-48bc-82e3-e481b02075c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:06.641808 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb3beb-b674-48bc-82e3-e481b02075c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.642126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb3beb-b674-48bc-82e3-e481b02075c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.642402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb3beb-b674-48bc-82e3-e481b02075c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.643131 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb3beb-b674-48bc-82e3-e481b02075c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:44:06.643435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb3beb-b674-48bc-82e3-e481b02075c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:06.645797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb3beb-b674-48bc-82e3-e481b02075c8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:06.657393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1113/2223] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:44:06.661701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c8757-d3b6-4039-a398-22bf96a3636a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:06.670756 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c8757-d3b6-4039-a398-22bf96a3636a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:06.675413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a620a4-649d-4681-b828-05ccfe2e474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:06.676047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a620a4-649d-4681-b828-05ccfe2e474c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.676375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a620a4-649d-4681-b828-05ccfe2e474c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.676654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a620a4-649d-4681-b828-05ccfe2e474c admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.677336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a620a4-649d-4681-b828-05ccfe2e474c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:06.679750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a620a4-649d-4681-b828-05ccfe2e474c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:06.704617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1111/2224] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:44:06 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:44:06.710435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb3beb-b674-48bc-82e3-e481b02075c8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:06.721887 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb3beb-b674-48bc-82e3-e481b02075c8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:06.775857 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e784ef-f752-4519-adde-03c052117b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:06.776470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e784ef-f752-4519-adde-03c052117b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.776751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e784ef-f752-4519-adde-03c052117b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.777025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e784ef-f752-4519-adde-03c052117b40 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.777710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e784ef-f752-4519-adde-03c052117b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:06.779686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e784ef-f752-4519-adde-03c052117b40 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:06.802960 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1114/2225] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:44:06 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:06.804896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a620a4-649d-4681-b828-05ccfe2e474c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:06.816291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a620a4-649d-4681-b828-05ccfe2e474c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:06.820972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824e0f9-4614-4b4f-920a-ad689923e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:06.821644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824e0f9-4614-4b4f-920a-ad689923e810 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.821910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824e0f9-4614-4b4f-920a-ad689923e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.822218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824e0f9-4614-4b4f-920a-ad689923e810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.822938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824e0f9-4614-4b4f-920a-ad689923e810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:06.824685 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824e0f9-4614-4b4f-920a-ad689923e810 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:06.835341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1112/2226] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:06.839511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e784ef-f752-4519-adde-03c052117b40 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:06.849318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e784ef-f752-4519-adde-03c052117b40 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:06.854868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d271fc-3022-45e7-ba24-e11712258d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:06.855525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d271fc-3022-45e7-ba24-e11712258d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.855805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d271fc-3022-45e7-ba24-e11712258d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.856081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d271fc-3022-45e7-ba24-e11712258d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.856814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d271fc-3022-45e7-ba24-e11712258d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:06.858490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d271fc-3022-45e7-ba24-e11712258d2d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:06.869608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1115/2227] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:06.873735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824e0f9-4614-4b4f-920a-ad689923e810 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:06.884071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824e0f9-4614-4b4f-920a-ad689923e810 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:06.888724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e099ebb-4e87-440a-83f6-b343623032e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:06.889606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099ebb-4e87-440a-83f6-b343623032e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.889887 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099ebb-4e87-440a-83f6-b343623032e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.890198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099ebb-4e87-440a-83f6-b343623032e7 admin admin] PATH_INFO: `/v3/projects/492e5075876e453f84afee93986fc9e8/users/2843ef7b90f8437e9d1d66dfae203976/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.904620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e099ebb-4e87-440a-83f6-b343623032e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492e5075876e453f84afee93986fc9e8, user_id=2843ef7b90f8437e9d1d66dfae203976, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:06.907307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e099ebb-4e87-440a-83f6-b343623032e7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:06.920807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1113/2228] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:06 2022] PUT /identity/v3/projects/492e5075876e453f84afee93986fc9e8/users/2843ef7b90f8437e9d1d66dfae203976/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:06.931641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52307-378c-4439-b2c9-723144586d86 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:06.931937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52307-378c-4439-b2c9-723144586d86 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:06.932245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52307-378c-4439-b2c9-723144586d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:06.957964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b9f52307-378c-4439-b2c9-723144586d86 None None] MFA Rules not processed for user `2843ef7b90f8437e9d1d66dfae203976`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:06.959194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b9f52307-378c-4439-b2c9-723144586d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:07.025231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1116/2229] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:07.029878 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e099ebb-4e87-440a-83f6-b343623032e7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:07.090552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e099ebb-4e87-440a-83f6-b343623032e7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:07.095237 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55275d3-da73-4741-ab38-bcac64fb1948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:07.095890 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55275d3-da73-4741-ab38-bcac64fb1948 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:07.096283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55275d3-da73-4741-ab38-bcac64fb1948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:07.096454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55275d3-da73-4741-ab38-bcac64fb1948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:07.097146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55275d3-da73-4741-ab38-bcac64fb1948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:07.099093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55275d3-da73-4741-ab38-bcac64fb1948 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:07.145811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1114/2230] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:44:07 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:07.150301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52307-378c-4439-b2c9-723144586d86 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:07.202140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52307-378c-4439-b2c9-723144586d86 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:07.259623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0c34c-c32c-45fe-8a42-46c7f9214465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:07.260412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c34c-c32c-45fe-8a42-46c7f9214465 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:07.260826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c34c-c32c-45fe-8a42-46c7f9214465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:07.261104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c34c-c32c-45fe-8a42-46c7f9214465 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:07.261840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0c34c-c32c-45fe-8a42-46c7f9214465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:07.263805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0c34c-c32c-45fe-8a42-46c7f9214465 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:07.284029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1117/2231] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:44:07 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:07.288256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55275d3-da73-4741-ab38-bcac64fb1948 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:07.329864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55275d3-da73-4741-ab38-bcac64fb1948 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:07.335248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75e55b-828a-4c36-80a6-b2e71a862baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:07.335908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75e55b-828a-4c36-80a6-b2e71a862baf admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:07.336189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75e55b-828a-4c36-80a6-b2e71a862baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:07.336457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75e55b-828a-4c36-80a6-b2e71a862baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:07.337172 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75e55b-828a-4c36-80a6-b2e71a862baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:07.338782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75e55b-828a-4c36-80a6-b2e71a862baf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:07.348438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1115/2232] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:07.353174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0c34c-c32c-45fe-8a42-46c7f9214465 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:07.363039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0c34c-c32c-45fe-8a42-46c7f9214465 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:07.368213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a892f-a15d-4d42-870e-74cba842dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:07.369087 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a892f-a15d-4d42-870e-74cba842dead admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:07.369372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a892f-a15d-4d42-870e-74cba842dead admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:07.369678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a892f-a15d-4d42-870e-74cba842dead admin admin] PATH_INFO: `/v3/projects/a01d25ad2c4e440d93a208782d48dba2/users/25bc22f381004d3a8548581b8a7e6cbb/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:07.384315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a892f-a15d-4d42-870e-74cba842dead admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01d25ad2c4e440d93a208782d48dba2, user_id=25bc22f381004d3a8548581b8a7e6cbb, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:07.387038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a892f-a15d-4d42-870e-74cba842dead admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:07.401182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1118/2233] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:07 2022] PUT /identity/v3/projects/a01d25ad2c4e440d93a208782d48dba2/users/25bc22f381004d3a8548581b8a7e6cbb/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:07.405219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75e55b-828a-4c36-80a6-b2e71a862baf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:07.416053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75e55b-828a-4c36-80a6-b2e71a862baf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:07.482992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eec55b-cb61-4a59-a62b-ae1dd9839563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:07.484681 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec55b-cb61-4a59-a62b-ae1dd9839563 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:07.484990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec55b-cb61-4a59-a62b-ae1dd9839563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:07.485288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec55b-cb61-4a59-a62b-ae1dd9839563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:07.486129 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eec55b-cb61-4a59-a62b-ae1dd9839563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:07.488796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eec55b-cb61-4a59-a62b-ae1dd9839563 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:07.504548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1116/2234] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:07.509204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a892f-a15d-4d42-870e-74cba842dead admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:07.520235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a892f-a15d-4d42-870e-74cba842dead admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:07.525575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf64c5c-a24d-4e3f-9a14-b8950bf5be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:07.526516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf64c5c-a24d-4e3f-9a14-b8950bf5be26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:07.526796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf64c5c-a24d-4e3f-9a14-b8950bf5be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:07.527095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf64c5c-a24d-4e3f-9a14-b8950bf5be26 admin admin] PATH_INFO: `/v3/projects/a01d25ad2c4e440d93a208782d48dba2/users/25bc22f381004d3a8548581b8a7e6cbb/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:07.529106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf64c5c-a24d-4e3f-9a14-b8950bf5be26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01d25ad2c4e440d93a208782d48dba2, user_id=25bc22f381004d3a8548581b8a7e6cbb, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:07.531802 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf64c5c-a24d-4e3f-9a14-b8950bf5be26 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:07.543535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1119/2235] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:07 2022] PUT /identity/v3/projects/a01d25ad2c4e440d93a208782d48dba2/users/25bc22f381004d3a8548581b8a7e6cbb/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:44:07.555524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4cf49-418b-46ec-9b7a-76a27755eee3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:07.555932 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4cf49-418b-46ec-9b7a-76a27755eee3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:07.556275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4cf49-418b-46ec-9b7a-76a27755eee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:07.588541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dee4cf49-418b-46ec-9b7a-76a27755eee3 None None] MFA Rules not processed for user `25bc22f381004d3a8548581b8a7e6cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:07.590406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dee4cf49-418b-46ec-9b7a-76a27755eee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:07.660050 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1117/2236] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:07.672255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf64c5c-a24d-4e3f-9a14-b8950bf5be26 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:07.674015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6bf64c5c-a24d-4e3f-9a14-b8950bf5be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:07.757853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf64c5c-a24d-4e3f-9a14-b8950bf5be26 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:07.761469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4279-33ee-4f54-9a9d-09d810eeb85d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:07.762136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4279-33ee-4f54-9a9d-09d810eeb85d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:07.762419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4279-33ee-4f54-9a9d-09d810eeb85d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:07.762690 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4279-33ee-4f54-9a9d-09d810eeb85d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:07.771300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e4279-33ee-4f54-9a9d-09d810eeb85d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:07.773290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e4279-33ee-4f54-9a9d-09d810eeb85d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:07.782450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1120/2237] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:07.825138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4cf49-418b-46ec-9b7a-76a27755eee3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:07.826713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dee4cf49-418b-46ec-9b7a-76a27755eee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:07.839019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4cf49-418b-46ec-9b7a-76a27755eee3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:07.842883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dff6a-e26e-4b4b-8dcc-77b109f5769c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:07.843552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dff6a-e26e-4b4b-8dcc-77b109f5769c service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:07.843861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dff6a-e26e-4b4b-8dcc-77b109f5769c service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:07.844164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dff6a-e26e-4b4b-8dcc-77b109f5769c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:07.900133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22dff6a-e26e-4b4b-8dcc-77b109f5769c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:07.901593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22dff6a-e26e-4b4b-8dcc-77b109f5769c service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:07.910243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1118/2238] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:44:11.153046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4279-33ee-4f54-9a9d-09d810eeb85d service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:11.229962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4279-33ee-4f54-9a9d-09d810eeb85d service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:11.248379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:11.249257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:11.249539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:11.249812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] PATH_INFO: `/v3/users/2843ef7b90f8437e9d1d66dfae203976` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:11.251058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2843ef7b90f8437e9d1d66dfae203976)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:11.253077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:11.299086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2843ef7b90f8437e9d1d66dfae203976'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.311426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2843ef7b90f8437e9d1d66dfae203976'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.312160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2843ef7b90f8437e9d1d66dfae203976'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.318786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2843ef7b90f8437e9d1d66dfae203976'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.325922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2843ef7b90f8437e9d1d66dfae203976'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.331823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1121/2239] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:44:11 2022] DELETE /identity/v3/users/2843ef7b90f8437e9d1d66dfae203976 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:11.336336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64c5aa-86f1-4e58-984c-cc9ad7b90025 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:11.336817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64c5aa-86f1-4e58-984c-cc9ad7b90025 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:11.336919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64c5aa-86f1-4e58-984c-cc9ad7b90025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:11.364703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cc64c5aa-86f1-4e58-984c-cc9ad7b90025 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:11.366475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cc64c5aa-86f1-4e58-984c-cc9ad7b90025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:11.426269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1119/2240] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:11.436414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:11.443174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:11.533115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ec7d-2dbb-4692-9c24-5108f2a64979 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:11.537015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d50438-3d05-475f-ade8-9d799a953747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:11.538493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d50438-3d05-475f-ade8-9d799a953747 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:11.538891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d50438-3d05-475f-ade8-9d799a953747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:11.539205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d50438-3d05-475f-ade8-9d799a953747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:11.550541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d50438-3d05-475f-ade8-9d799a953747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:11.552161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d50438-3d05-475f-ade8-9d799a953747 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:11.563082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1122/2241] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:11.837366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64c5aa-86f1-4e58-984c-cc9ad7b90025 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:11.839120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cc64c5aa-86f1-4e58-984c-cc9ad7b90025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:11.858300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64c5aa-86f1-4e58-984c-cc9ad7b90025 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:11.869823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:11.870731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:11.871017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:11.871289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] PATH_INFO: `/v3/projects/492e5075876e453f84afee93986fc9e8` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:11.872763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492e5075876e453f84afee93986fc9e8)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:11.874961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:11.930032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492e5075876e453f84afee93986fc9e8', 'request_id': 'req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.936258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492e5075876e453f84afee93986fc9e8', 'request_id': 'req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.942729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492e5075876e453f84afee93986fc9e8', 'request_id': 'req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.952561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] The token cache is being invalidate because project 492e5075876e453f84afee93986fc9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:44:11.952845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.953466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:11.955036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1120/2242] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:44:11 2022] DELETE /identity/v3/projects/492e5075876e453f84afee93986fc9e8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:44:11.958989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d50438-3d05-475f-ade8-9d799a953747 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:11.969324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d50438-3d05-475f-ade8-9d799a953747 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:12.025702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:12.026597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.026884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.027186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] PATH_INFO: `/v3/users/25bc22f381004d3a8548581b8a7e6cbb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.028370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bc22f381004d3a8548581b8a7e6cbb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:12.030344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:12.074716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bc22f381004d3a8548581b8a7e6cbb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.085816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bc22f381004d3a8548581b8a7e6cbb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.086498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bc22f381004d3a8548581b8a7e6cbb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.093723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bc22f381004d3a8548581b8a7e6cbb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.101038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-795f7ed9-e51c-4d40-a284-7cb302ce9259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bc22f381004d3a8548581b8a7e6cbb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.107105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1123/2243] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:44:11 2022] DELETE /identity/v3/users/25bc22f381004d3a8548581b8a7e6cbb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:12.364644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:12.366229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:12.382757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e825a4-19e3-429a-8ed4-dfe4cd4c5d23 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:12.441967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:12.442850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.443132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.443407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] PATH_INFO: `/v3/projects/a01d25ad2c4e440d93a208782d48dba2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.444786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01d25ad2c4e440d93a208782d48dba2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:12.446780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:12.491547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01d25ad2c4e440d93a208782d48dba2', 'request_id': 'req-1fd0e98b-2902-4852-a9b4-fa8750b05772'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.498244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01d25ad2c4e440d93a208782d48dba2', 'request_id': 'req-1fd0e98b-2902-4852-a9b4-fa8750b05772'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.505979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01d25ad2c4e440d93a208782d48dba2', 'request_id': 'req-1fd0e98b-2902-4852-a9b4-fa8750b05772'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.516684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] The token cache is being invalidate because project a01d25ad2c4e440d93a208782d48dba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:44:12.516973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.517636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1fd0e98b-2902-4852-a9b4-fa8750b05772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:12.519446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1121/2244] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:44:12 2022] DELETE /identity/v3/projects/a01d25ad2c4e440d93a208782d48dba2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:12.524584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ffef6-695f-40de-96eb-77640a051fd9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.525058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ffef6-695f-40de-96eb-77640a051fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.525269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ffef6-695f-40de-96eb-77640a051fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.561512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8a6ffef6-695f-40de-96eb-77640a051fd9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:12.562682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8a6ffef6-695f-40de-96eb-77640a051fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:12.619869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1124/2245] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:12.627966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270534-61c2-4a8e-af20-2098988b7715 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.628253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270534-61c2-4a8e-af20-2098988b7715 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.628529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270534-61c2-4a8e-af20-2098988b7715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.646198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9c270534-61c2-4a8e-af20-2098988b7715 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:12.647880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9c270534-61c2-4a8e-af20-2098988b7715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:12.655596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1122/2246] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:12.659734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ffef6-695f-40de-96eb-77640a051fd9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:12.669807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ffef6-695f-40de-96eb-77640a051fd9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:12.674315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef58d0-4ff2-4867-a1b5-06e5a58fa3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:12.674984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef58d0-4ff2-4867-a1b5-06e5a58fa3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.675287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef58d0-4ff2-4867-a1b5-06e5a58fa3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.675561 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef58d0-4ff2-4867-a1b5-06e5a58fa3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.676286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef58d0-4ff2-4867-a1b5-06e5a58fa3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:44:12.676589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef58d0-4ff2-4867-a1b5-06e5a58fa3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:12.678238 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef58d0-4ff2-4867-a1b5-06e5a58fa3cb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:12.689302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1125/2247] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:44:12.693582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c270534-61c2-4a8e-af20-2098988b7715 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:12.703123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c270534-61c2-4a8e-af20-2098988b7715 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:12.707895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3a4a-fc1d-41c3-8894-791d4bca0046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:12.708575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3a4a-fc1d-41c3-8894-791d4bca0046 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.708862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3a4a-fc1d-41c3-8894-791d4bca0046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.709141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3a4a-fc1d-41c3-8894-791d4bca0046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.710872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd3a4a-fc1d-41c3-8894-791d4bca0046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:12.712982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd3a4a-fc1d-41c3-8894-791d4bca0046 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:12.739875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1123/2248] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:44:12 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:12.743923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef58d0-4ff2-4867-a1b5-06e5a58fa3cb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:12.753618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef58d0-4ff2-4867-a1b5-06e5a58fa3cb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:12.810095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17b79-f104-4db3-977a-8024a39cae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:12.810757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17b79-f104-4db3-977a-8024a39cae17 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.811038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17b79-f104-4db3-977a-8024a39cae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.811337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17b79-f104-4db3-977a-8024a39cae17 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.812030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17b79-f104-4db3-977a-8024a39cae17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:12.813928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17b79-f104-4db3-977a-8024a39cae17 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:12.834099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1126/2249] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:44:12 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:44:12.838799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3a4a-fc1d-41c3-8894-791d4bca0046 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:12.850060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3a4a-fc1d-41c3-8894-791d4bca0046 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:12.855169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae4e2-69ed-45a7-8d76-572479d10f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:12.855826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae4e2-69ed-45a7-8d76-572479d10f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.856141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae4e2-69ed-45a7-8d76-572479d10f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.856415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae4e2-69ed-45a7-8d76-572479d10f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.857150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae4e2-69ed-45a7-8d76-572479d10f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:12.858760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae4e2-69ed-45a7-8d76-572479d10f28 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:12.869658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1124/2250] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:12.873405 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17b79-f104-4db3-977a-8024a39cae17 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:12.884148 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17b79-f104-4db3-977a-8024a39cae17 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:12.888848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57c750-f9f1-4f5a-acc7-05f2f478d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:12.889508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57c750-f9f1-4f5a-acc7-05f2f478d28c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.889795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57c750-f9f1-4f5a-acc7-05f2f478d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.890094 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57c750-f9f1-4f5a-acc7-05f2f478d28c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.890874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57c750-f9f1-4f5a-acc7-05f2f478d28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:12.892455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57c750-f9f1-4f5a-acc7-05f2f478d28c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:12.905552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1127/2251] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:12.909773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae4e2-69ed-45a7-8d76-572479d10f28 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:12.919919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae4e2-69ed-45a7-8d76-572479d10f28 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:12.924489 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcd903-8ab3-4cde-bc22-a2e511b4756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:12.925356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcd903-8ab3-4cde-bc22-a2e511b4756d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.925633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcd903-8ab3-4cde-bc22-a2e511b4756d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.925901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcd903-8ab3-4cde-bc22-a2e511b4756d admin admin] PATH_INFO: `/v3/projects/e11747eeac8e444fb38172ea553b5132/users/e75a851b1ab14898a31e58389ee190df/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:12.941844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcd903-8ab3-4cde-bc22-a2e511b4756d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11747eeac8e444fb38172ea553b5132, user_id=e75a851b1ab14898a31e58389ee190df, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:12.945037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcd903-8ab3-4cde-bc22-a2e511b4756d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:12.968809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1125/2252] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:12 2022] PUT /identity/v3/projects/e11747eeac8e444fb38172ea553b5132/users/e75a851b1ab14898a31e58389ee190df/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:12.982222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747fbbe-7de8-48cc-af7e-d9efa43a87bd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:12.982680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747fbbe-7de8-48cc-af7e-d9efa43a87bd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:12.983081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747fbbe-7de8-48cc-af7e-d9efa43a87bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:13.015058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8747fbbe-7de8-48cc-af7e-d9efa43a87bd None None] MFA Rules not processed for user `e75a851b1ab14898a31e58389ee190df`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:13.016315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8747fbbe-7de8-48cc-af7e-d9efa43a87bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:13.081290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1128/2253] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:13.092839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcd903-8ab3-4cde-bc22-a2e511b4756d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:13.094627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ecbcd903-8ab3-4cde-bc22-a2e511b4756d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:13.154349 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcd903-8ab3-4cde-bc22-a2e511b4756d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:13.158080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6230e0-75ff-45d8-b862-c7a366310f79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22c0e889e1f842b2a6081f38aabd97ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:13.158729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6230e0-75ff-45d8-b862-c7a366310f79 service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:13.159014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6230e0-75ff-45d8-b862-c7a366310f79 service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:13.159292 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6230e0-75ff-45d8-b862-c7a366310f79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:13.169064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6230e0-75ff-45d8-b862-c7a366310f79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:13.170597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6230e0-75ff-45d8-b862-c7a366310f79 service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:13.179958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1126/2254] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:24.539372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c6f4-c060-4718-936a-b8613135b47a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:24.539848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c6f4-c060-4718-936a-b8613135b47a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:24.539979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c6f4-c060-4718-936a-b8613135b47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:24.558878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e033c6f4-c060-4718-936a-b8613135b47a None None] MFA Rules not processed for user `8f0f8ee6e0d24c749a405850ba15f560`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:24.560066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e033c6f4-c060-4718-936a-b8613135b47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:24.614402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1129/2255] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:25.598240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6230e0-75ff-45d8-b862-c7a366310f79 service glance] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:25.600358 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4b6230e0-75ff-45d8-b862-c7a366310f79 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:25.665288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6230e0-75ff-45d8-b862-c7a366310f79 service glance] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:25.670520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:25.671403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:25.671807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:25.672089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] PATH_INFO: `/v3/users/815dc2e355ed4ca1b20682dca905b713` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:25.673511 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=815dc2e355ed4ca1b20682dca905b713)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:25.675904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:25.724031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '815dc2e355ed4ca1b20682dca905b713'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:25.737043 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '815dc2e355ed4ca1b20682dca905b713'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:25.737835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '815dc2e355ed4ca1b20682dca905b713'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:25.738515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '815dc2e355ed4ca1b20682dca905b713'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:25.745983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '815dc2e355ed4ca1b20682dca905b713'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:25.761794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1127/2256] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:44:25 2022] DELETE /identity/v3/users/815dc2e355ed4ca1b20682dca905b713 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:25.769493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6e48-0020-4f09-aa78-376a3af2c984 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:25.770252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6e48-0020-4f09-aa78-376a3af2c984 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:25.770424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6e48-0020-4f09-aa78-376a3af2c984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:25.791138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-645f6e48-0020-4f09-aa78-376a3af2c984 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:25.795600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-645f6e48-0020-4f09-aa78-376a3af2c984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:25.867026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1130/2257] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:25.873543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:25.875219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:25.935236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f52ef-342b-4232-8c27-a23e546d89ba admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:25.938973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087c42f-3730-4394-85da-5e979b7669b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:25.939622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c42f-3730-4394-85da-5e979b7669b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:25.939906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c42f-3730-4394-85da-5e979b7669b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:25.940182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c42f-3730-4394-85da-5e979b7669b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:25.952271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087c42f-3730-4394-85da-5e979b7669b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:25.953718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087c42f-3730-4394-85da-5e979b7669b6 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:25.965197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1128/2258] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:26.260123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6e48-0020-4f09-aa78-376a3af2c984 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:26.261818 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-645f6e48-0020-4f09-aa78-376a3af2c984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:26.280333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6e48-0020-4f09-aa78-376a3af2c984 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:26.286073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:26.286947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.287277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.287557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] PATH_INFO: `/v3/projects/9bf9dcda23f14ae397cdbb7dde1e79fe` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.288772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf9dcda23f14ae397cdbb7dde1e79fe)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:26.290796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:26.347119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf9dcda23f14ae397cdbb7dde1e79fe', 'request_id': 'req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:26.354395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf9dcda23f14ae397cdbb7dde1e79fe', 'request_id': 'req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:26.363540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf9dcda23f14ae397cdbb7dde1e79fe', 'request_id': 'req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:26.376615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] The token cache is being invalidate because project 9bf9dcda23f14ae397cdbb7dde1e79fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:44:26.376894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:26.379977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f1566f5-abbb-4805-bf04-f2fa8ace2a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:26.383501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1131/2259] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:44:26 2022] DELETE /identity/v3/projects/9bf9dcda23f14ae397cdbb7dde1e79fe => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:26.388439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030fae1-ce55-46ae-a318-59226534198a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.388801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030fae1-ce55-46ae-a318-59226534198a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.389154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030fae1-ce55-46ae-a318-59226534198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.423926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b030fae1-ce55-46ae-a318-59226534198a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:26.425136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b030fae1-ce55-46ae-a318-59226534198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:26.507418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1129/2260] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:26.510737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9612237-7226-4448-aadc-cb24ba4a4764 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.510924 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9612237-7226-4448-aadc-cb24ba4a4764 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.511191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9612237-7226-4448-aadc-cb24ba4a4764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.531754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d9612237-7226-4448-aadc-cb24ba4a4764 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:26.532980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d9612237-7226-4448-aadc-cb24ba4a4764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:26.541066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1132/2261] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:44:26.545302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030fae1-ce55-46ae-a318-59226534198a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:26.554845 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030fae1-ce55-46ae-a318-59226534198a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:26.559428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1175-1f98-4962-a0b0-dc686c866935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:26.560081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1175-1f98-4962-a0b0-dc686c866935 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.560357 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1175-1f98-4962-a0b0-dc686c866935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.560630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1175-1f98-4962-a0b0-dc686c866935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.561346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1175-1f98-4962-a0b0-dc686c866935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:44:26.561648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1175-1f98-4962-a0b0-dc686c866935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:26.563275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1175-1f98-4962-a0b0-dc686c866935 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:26.577771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1130/2262] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:44:26.582208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9612237-7226-4448-aadc-cb24ba4a4764 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:26.591959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9612237-7226-4448-aadc-cb24ba4a4764 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:26.597170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfa4cf-d9dd-461d-a653-86df969543cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:26.597828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfa4cf-d9dd-461d-a653-86df969543cc admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.598145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfa4cf-d9dd-461d-a653-86df969543cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.598422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfa4cf-d9dd-461d-a653-86df969543cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.599145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfa4cf-d9dd-461d-a653-86df969543cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:26.601120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfa4cf-d9dd-461d-a653-86df969543cc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:26.630080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1133/2263] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:44:26 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:26.639136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1175-1f98-4962-a0b0-dc686c866935 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:26.650200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1175-1f98-4962-a0b0-dc686c866935 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:26.713094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51d0e4-e90f-4df5-91f0-39ef02028a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:26.713926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d0e4-e90f-4df5-91f0-39ef02028a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.714313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d0e4-e90f-4df5-91f0-39ef02028a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.714730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d0e4-e90f-4df5-91f0-39ef02028a84 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.715625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51d0e4-e90f-4df5-91f0-39ef02028a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:26.718089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51d0e4-e90f-4df5-91f0-39ef02028a84 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:26.741304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1131/2264] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:44:26 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:26.742501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfa4cf-d9dd-461d-a653-86df969543cc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:26.752901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfa4cf-d9dd-461d-a653-86df969543cc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:26.757816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351350d-feb9-4c9f-99fb-8a0cf13b5d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:26.758517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351350d-feb9-4c9f-99fb-8a0cf13b5d20 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.758800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351350d-feb9-4c9f-99fb-8a0cf13b5d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.759075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351350d-feb9-4c9f-99fb-8a0cf13b5d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.759838 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351350d-feb9-4c9f-99fb-8a0cf13b5d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:26.761563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351350d-feb9-4c9f-99fb-8a0cf13b5d20 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:26.772901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1134/2265] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:44:26.776739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51d0e4-e90f-4df5-91f0-39ef02028a84 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:26.791437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51d0e4-e90f-4df5-91f0-39ef02028a84 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:26.796875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e6c42-4bc1-4132-8233-5bccf1beb818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:26.797666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6c42-4bc1-4132-8233-5bccf1beb818 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.797852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6c42-4bc1-4132-8233-5bccf1beb818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.798174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6c42-4bc1-4132-8233-5bccf1beb818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.798917 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e6c42-4bc1-4132-8233-5bccf1beb818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:26.801151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e6c42-4bc1-4132-8233-5bccf1beb818 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:26.812536 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1132/2266] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:26.816604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351350d-feb9-4c9f-99fb-8a0cf13b5d20 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:26.827908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351350d-feb9-4c9f-99fb-8a0cf13b5d20 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:26.832860 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaab7d-717e-4b94-9c2f-00b01caf42b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:26.834352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaab7d-717e-4b94-9c2f-00b01caf42b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.834682 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaab7d-717e-4b94-9c2f-00b01caf42b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.835144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaab7d-717e-4b94-9c2f-00b01caf42b6 admin admin] PATH_INFO: `/v3/projects/8546f4adc32f40ed86a7e34a21025dab/users/fab7654ec1ee473e8725950c7bef0933/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.850976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaab7d-717e-4b94-9c2f-00b01caf42b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8546f4adc32f40ed86a7e34a21025dab, user_id=fab7654ec1ee473e8725950c7bef0933, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:26.853918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaab7d-717e-4b94-9c2f-00b01caf42b6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:26.870838 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1135/2267] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:26 2022] PUT /identity/v3/projects/8546f4adc32f40ed86a7e34a21025dab/users/fab7654ec1ee473e8725950c7bef0933/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:26.882342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e6c87-ed8d-4367-864d-ba126be42033 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:26.882566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e6c87-ed8d-4367-864d-ba126be42033 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:26.882843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e6c87-ed8d-4367-864d-ba126be42033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:26.914185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-728e6c87-ed8d-4367-864d-ba126be42033 None None] MFA Rules not processed for user `fab7654ec1ee473e8725950c7bef0933`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:26.915419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-728e6c87-ed8d-4367-864d-ba126be42033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:26.984837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1133/2268] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:26.996297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaab7d-717e-4b94-9c2f-00b01caf42b6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:26.998852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6efaab7d-717e-4b94-9c2f-00b01caf42b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:27.061766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaab7d-717e-4b94-9c2f-00b01caf42b6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:27.066614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5b60c-b23b-4baa-b1f0-45329e6782a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:27.067466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5b60c-b23b-4baa-b1f0-45329e6782a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:27.067952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5b60c-b23b-4baa-b1f0-45329e6782a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:27.068345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5b60c-b23b-4baa-b1f0-45329e6782a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:27.081369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5b60c-b23b-4baa-b1f0-45329e6782a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:27.083140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5b60c-b23b-4baa-b1f0-45329e6782a2 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:27.093571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1136/2269] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:44:27.126206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e6c87-ed8d-4367-864d-ba126be42033 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:27.240913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e6c87-ed8d-4367-864d-ba126be42033 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:27.249965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:27.250919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:27.251200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:27.251473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] PATH_INFO: `/v3/users/fab7654ec1ee473e8725950c7bef0933` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:27.252699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab7654ec1ee473e8725950c7bef0933)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:27.254828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:27.313437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab7654ec1ee473e8725950c7bef0933'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:27.327218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab7654ec1ee473e8725950c7bef0933'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:27.328208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab7654ec1ee473e8725950c7bef0933'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:27.328812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab7654ec1ee473e8725950c7bef0933'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:27.336919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab7654ec1ee473e8725950c7bef0933'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:27.350071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1134/2270] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:44:27 2022] DELETE /identity/v3/users/fab7654ec1ee473e8725950c7bef0933 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:27.354649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716abf-4acd-4427-9fd2-f2b935e334e6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:27.354947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716abf-4acd-4427-9fd2-f2b935e334e6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:27.355225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716abf-4acd-4427-9fd2-f2b935e334e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:27.373261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-23716abf-4acd-4427-9fd2-f2b935e334e6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:27.374509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-23716abf-4acd-4427-9fd2-f2b935e334e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:27.435443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1137/2271] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:27.445468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:27.446807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:27.504208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67343-9f59-42e8-882c-dc79eccce903 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:27.508059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01959e16-174f-412c-858b-31f1969b4fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:27.508751 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01959e16-174f-412c-858b-31f1969b4fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:27.509037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01959e16-174f-412c-858b-31f1969b4fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:27.509315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01959e16-174f-412c-858b-31f1969b4fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:27.518757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01959e16-174f-412c-858b-31f1969b4fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:27.520226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01959e16-174f-412c-858b-31f1969b4fd7 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:27.530773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1135/2272] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:27.941344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23716abf-4acd-4427-9fd2-f2b935e334e6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:27.942879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-23716abf-4acd-4427-9fd2-f2b935e334e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:27.960953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23716abf-4acd-4427-9fd2-f2b935e334e6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:27.966098 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:27.966870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:27.967152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:27.967481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] PATH_INFO: `/v3/projects/8546f4adc32f40ed86a7e34a21025dab` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:27.968654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8546f4adc32f40ed86a7e34a21025dab)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:27.970605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:28.023593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8546f4adc32f40ed86a7e34a21025dab', 'request_id': 'req-026df6db-e585-48f5-b6a3-22352ed8be7b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:28.030597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8546f4adc32f40ed86a7e34a21025dab', 'request_id': 'req-026df6db-e585-48f5-b6a3-22352ed8be7b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:28.040122 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8546f4adc32f40ed86a7e34a21025dab', 'request_id': 'req-026df6db-e585-48f5-b6a3-22352ed8be7b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:28.053426 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] The token cache is being invalidate because project 8546f4adc32f40ed86a7e34a21025dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:44:28.053734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:28.054472 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-026df6db-e585-48f5-b6a3-22352ed8be7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:28.056378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1138/2273] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:44:27 2022] DELETE /identity/v3/projects/8546f4adc32f40ed86a7e34a21025dab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:28.067447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30183e8-5cba-49d8-a702-5f22249504f1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.067978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30183e8-5cba-49d8-a702-5f22249504f1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.068580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30183e8-5cba-49d8-a702-5f22249504f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.093919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e30183e8-5cba-49d8-a702-5f22249504f1 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:28.095188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e30183e8-5cba-49d8-a702-5f22249504f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:28.160231 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1136/2274] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:28.167896 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d060-8d56-4144-bd25-353163a62842 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.168188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d060-8d56-4144-bd25-353163a62842 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.168498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d060-8d56-4144-bd25-353163a62842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.187944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6310d060-8d56-4144-bd25-353163a62842 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:28.189184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6310d060-8d56-4144-bd25-353163a62842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:28.197948 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1139/2275] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:28.202146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30183e8-5cba-49d8-a702-5f22249504f1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:28.211876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30183e8-5cba-49d8-a702-5f22249504f1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:28.216752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d5f4-0c26-4bd9-96c0-59c5b3fa925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:28.217363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d5f4-0c26-4bd9-96c0-59c5b3fa925d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.218342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d5f4-0c26-4bd9-96c0-59c5b3fa925d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.218712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d5f4-0c26-4bd9-96c0-59c5b3fa925d admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.219623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349d5f4-0c26-4bd9-96c0-59c5b3fa925d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:44:28.219940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349d5f4-0c26-4bd9-96c0-59c5b3fa925d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:28.221584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349d5f4-0c26-4bd9-96c0-59c5b3fa925d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:28.233874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1137/2276] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:44:28.238095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d060-8d56-4144-bd25-353163a62842 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:28.249493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d060-8d56-4144-bd25-353163a62842 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:28.254326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edd858-6928-44c7-b4a1-679a00fcc9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:28.254980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd858-6928-44c7-b4a1-679a00fcc9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.255262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd858-6928-44c7-b4a1-679a00fcc9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.255535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd858-6928-44c7-b4a1-679a00fcc9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.256878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edd858-6928-44c7-b4a1-679a00fcc9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:28.258796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edd858-6928-44c7-b4a1-679a00fcc9e2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:28.293620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1140/2277] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:44:28 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:28.294624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d5f4-0c26-4bd9-96c0-59c5b3fa925d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:28.304923 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d5f4-0c26-4bd9-96c0-59c5b3fa925d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:28.363791 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5e14e-4e30-4e18-8d70-7ec4f059e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:28.364149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e14e-4e30-4e18-8d70-7ec4f059e631 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.364438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e14e-4e30-4e18-8d70-7ec4f059e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.364708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e14e-4e30-4e18-8d70-7ec4f059e631 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.366060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5e14e-4e30-4e18-8d70-7ec4f059e631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:28.368259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5e14e-4e30-4e18-8d70-7ec4f059e631 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:28.388558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1138/2278] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:44:28 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:44:28.393381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edd858-6928-44c7-b4a1-679a00fcc9e2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:28.403672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edd858-6928-44c7-b4a1-679a00fcc9e2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:28.408622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910534b-7ace-451f-be0c-e4abdc568594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:28.409274 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910534b-7ace-451f-be0c-e4abdc568594 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.409554 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910534b-7ace-451f-be0c-e4abdc568594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.409855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910534b-7ace-451f-be0c-e4abdc568594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.410648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910534b-7ace-451f-be0c-e4abdc568594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:28.412292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910534b-7ace-451f-be0c-e4abdc568594 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:28.426907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1141/2279] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:28.428588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5e14e-4e30-4e18-8d70-7ec4f059e631 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:28.438683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5e14e-4e30-4e18-8d70-7ec4f059e631 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:28.443962 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402306a-bd46-4573-8634-3e6fc6b2dc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:28.444616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402306a-bd46-4573-8634-3e6fc6b2dc98 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.444896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402306a-bd46-4573-8634-3e6fc6b2dc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.445171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402306a-bd46-4573-8634-3e6fc6b2dc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.445892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402306a-bd46-4573-8634-3e6fc6b2dc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:28.447523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402306a-bd46-4573-8634-3e6fc6b2dc98 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:28.457512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1139/2280] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:28.461564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910534b-7ace-451f-be0c-e4abdc568594 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:28.471371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910534b-7ace-451f-be0c-e4abdc568594 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:28.476434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0b5cb-7cbb-4b64-bc4b-55172980e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:28.477555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0b5cb-7cbb-4b64-bc4b-55172980e71f admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.477829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0b5cb-7cbb-4b64-bc4b-55172980e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.478131 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0b5cb-7cbb-4b64-bc4b-55172980e71f admin admin] PATH_INFO: `/v3/projects/29ff5f34a5094ef9a5c8c4b5b924415b/users/b860a94349204b7d86ad796882dcd402/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.492964 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0b5cb-7cbb-4b64-bc4b-55172980e71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ff5f34a5094ef9a5c8c4b5b924415b, user_id=b860a94349204b7d86ad796882dcd402, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:28.495652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0b5cb-7cbb-4b64-bc4b-55172980e71f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:28.507973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1142/2281] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:28 2022] PUT /identity/v3/projects/29ff5f34a5094ef9a5c8c4b5b924415b/users/b860a94349204b7d86ad796882dcd402/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:28.518306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03538f-c3b8-4bad-894b-749dd6da60dd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.518595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03538f-c3b8-4bad-894b-749dd6da60dd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.518869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03538f-c3b8-4bad-894b-749dd6da60dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.545442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7d03538f-c3b8-4bad-894b-749dd6da60dd None None] MFA Rules not processed for user `b860a94349204b7d86ad796882dcd402`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:28.546716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7d03538f-c3b8-4bad-894b-749dd6da60dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:28.618264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1140/2282] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:28.629063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0b5cb-7cbb-4b64-bc4b-55172980e71f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:28.630859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aeb0b5cb-7cbb-4b64-bc4b-55172980e71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:28.686393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0b5cb-7cbb-4b64-bc4b-55172980e71f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:28.690050 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55147-ee44-40bd-97d2-7d1b8269d37f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:28.690693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55147-ee44-40bd-97d2-7d1b8269d37f service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:28.690978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55147-ee44-40bd-97d2-7d1b8269d37f service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:28.691254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55147-ee44-40bd-97d2-7d1b8269d37f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:28.699659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d55147-ee44-40bd-97d2-7d1b8269d37f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:28.701092 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d55147-ee44-40bd-97d2-7d1b8269d37f service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:28.710159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1143/2283] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:30.049331 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164957d-e76f-4b1b-bc23-b3bb4b0d49e2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:30.049820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164957d-e76f-4b1b-bc23-b3bb4b0d49e2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:30.049936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164957d-e76f-4b1b-bc23-b3bb4b0d49e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:30.067259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7164957d-e76f-4b1b-bc23-b3bb4b0d49e2 None None] MFA Rules not processed for user `b860a94349204b7d86ad796882dcd402`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:30.068463 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7164957d-e76f-4b1b-bc23-b3bb4b0d49e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:30.075166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1141/2284] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:42.247161 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55147-ee44-40bd-97d2-7d1b8269d37f service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:42.248649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-67d55147-ee44-40bd-97d2-7d1b8269d37f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:42.310258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55147-ee44-40bd-97d2-7d1b8269d37f service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:42.314755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:42.315611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:42.315895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:42.316172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] PATH_INFO: `/v3/users/e75a851b1ab14898a31e58389ee190df` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:42.317347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75a851b1ab14898a31e58389ee190df)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:42.319278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:42.363399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75a851b1ab14898a31e58389ee190df'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:42.374505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75a851b1ab14898a31e58389ee190df'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:42.375183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75a851b1ab14898a31e58389ee190df'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:42.381863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75a851b1ab14898a31e58389ee190df'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:42.388951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75a851b1ab14898a31e58389ee190df'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:42.394545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1144/2285] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:44:42 2022] DELETE /identity/v3/users/e75a851b1ab14898a31e58389ee190df => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:42.399623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979534-8b79-4e47-87d1-f3c6ff013462 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:42.400119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979534-8b79-4e47-87d1-f3c6ff013462 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:42.400240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979534-8b79-4e47-87d1-f3c6ff013462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:42.417936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-50979534-8b79-4e47-87d1-f3c6ff013462 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:42.419174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-50979534-8b79-4e47-87d1-f3c6ff013462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:42.479788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1142/2286] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:42.489728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:42.491184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:42.548105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08879286-a316-419e-a372-7777aece1a52 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:42.551831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d32d1d-1ae2-438a-8955-4c788a3d20d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:42.552497 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d32d1d-1ae2-438a-8955-4c788a3d20d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:42.552783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d32d1d-1ae2-438a-8955-4c788a3d20d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:42.553060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d32d1d-1ae2-438a-8955-4c788a3d20d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:42.562476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d32d1d-1ae2-438a-8955-4c788a3d20d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:42.563985 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d32d1d-1ae2-438a-8955-4c788a3d20d8 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:42.574384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1145/2287] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:42.965486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50979534-8b79-4e47-87d1-f3c6ff013462 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:42.967066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-50979534-8b79-4e47-87d1-f3c6ff013462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:42.979979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50979534-8b79-4e47-87d1-f3c6ff013462 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:42.984971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:42.986216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:42.986688 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:42.987127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] PATH_INFO: `/v3/projects/e11747eeac8e444fb38172ea553b5132` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:42.988763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11747eeac8e444fb38172ea553b5132)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:42.991568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:43.043005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11747eeac8e444fb38172ea553b5132', 'request_id': 'req-39b02a6f-943e-46bc-a606-0f078d48412f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:43.049304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11747eeac8e444fb38172ea553b5132', 'request_id': 'req-39b02a6f-943e-46bc-a606-0f078d48412f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:43.062173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11747eeac8e444fb38172ea553b5132', 'request_id': 'req-39b02a6f-943e-46bc-a606-0f078d48412f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:43.073986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] The token cache is being invalidate because project e11747eeac8e444fb38172ea553b5132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:44:43.074530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:43.075334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-39b02a6f-943e-46bc-a606-0f078d48412f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:43.076968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1143/2288] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:44:42 2022] DELETE /identity/v3/projects/e11747eeac8e444fb38172ea553b5132 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:43.082162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd489-4e36-4bf4-884e-ed1805b4e27f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.082450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd489-4e36-4bf4-884e-ed1805b4e27f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.082727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd489-4e36-4bf4-884e-ed1805b4e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.101549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a2bfd489-4e36-4bf4-884e-ed1805b4e27f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:43.103118 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a2bfd489-4e36-4bf4-884e-ed1805b4e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:43.166761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1146/2289] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:43.175133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2790e-3fe5-4a59-84dd-6b1fcbefe86a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.175415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2790e-3fe5-4a59-84dd-6b1fcbefe86a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.175686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2790e-3fe5-4a59-84dd-6b1fcbefe86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.194921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4be2790e-3fe5-4a59-84dd-6b1fcbefe86a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:43.196114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4be2790e-3fe5-4a59-84dd-6b1fcbefe86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:43.203910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1144/2290] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:43.208141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfd489-4e36-4bf4-884e-ed1805b4e27f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:43.217834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfd489-4e36-4bf4-884e-ed1805b4e27f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:43.222487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e797e3-f680-4241-870e-971a173331f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:43.223140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e797e3-f680-4241-870e-971a173331f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.223419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e797e3-f680-4241-870e-971a173331f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.223691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e797e3-f680-4241-870e-971a173331f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.224418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e797e3-f680-4241-870e-971a173331f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:44:43.224722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e797e3-f680-4241-870e-971a173331f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:43.226334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e797e3-f680-4241-870e-971a173331f2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:43.243358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1147/2291] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:44:43.244541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2790e-3fe5-4a59-84dd-6b1fcbefe86a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:43.254299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2790e-3fe5-4a59-84dd-6b1fcbefe86a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:43.259549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b47cfc-8ef6-491d-8ed8-df249a39457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:43.260192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b47cfc-8ef6-491d-8ed8-df249a39457a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.260470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b47cfc-8ef6-491d-8ed8-df249a39457a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.260739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b47cfc-8ef6-491d-8ed8-df249a39457a admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.261411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b47cfc-8ef6-491d-8ed8-df249a39457a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:43.263452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b47cfc-8ef6-491d-8ed8-df249a39457a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:43.290035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1145/2292] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:44:43 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:43.293062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e797e3-f680-4241-870e-971a173331f2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:43.303384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e797e3-f680-4241-870e-971a173331f2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:43.363086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39682501-8b4c-4f68-8a1f-0370a5a6c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:43.363760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39682501-8b4c-4f68-8a1f-0370a5a6c457 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.364048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39682501-8b4c-4f68-8a1f-0370a5a6c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.364326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39682501-8b4c-4f68-8a1f-0370a5a6c457 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.365680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39682501-8b4c-4f68-8a1f-0370a5a6c457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:43.367641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39682501-8b4c-4f68-8a1f-0370a5a6c457 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:43.391056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1148/2293] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:44:43 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:43.392174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b47cfc-8ef6-491d-8ed8-df249a39457a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:43.402912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b47cfc-8ef6-491d-8ed8-df249a39457a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:43.408195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db54bf-2586-40ed-8227-fe008e857cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:43.408860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db54bf-2586-40ed-8227-fe008e857cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.409143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db54bf-2586-40ed-8227-fe008e857cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.409420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db54bf-2586-40ed-8227-fe008e857cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.410173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db54bf-2586-40ed-8227-fe008e857cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:43.411817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db54bf-2586-40ed-8227-fe008e857cd7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:43.422360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1146/2294] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:43.426294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39682501-8b4c-4f68-8a1f-0370a5a6c457 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:43.436945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39682501-8b4c-4f68-8a1f-0370a5a6c457 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:43.441817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8bca-8a67-4f37-88dc-36feea2f180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:43.442489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8bca-8a67-4f37-88dc-36feea2f180f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.443617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8bca-8a67-4f37-88dc-36feea2f180f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.443891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8bca-8a67-4f37-88dc-36feea2f180f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.444614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a8bca-8a67-4f37-88dc-36feea2f180f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:43.446219 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a8bca-8a67-4f37-88dc-36feea2f180f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:43.455810 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1149/2295] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:43.459704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db54bf-2586-40ed-8227-fe008e857cd7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:43.469369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db54bf-2586-40ed-8227-fe008e857cd7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:43.474390 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5da94b-2f4e-4d89-8dff-564287c8dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:43.475252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5da94b-2f4e-4d89-8dff-564287c8dd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.475532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5da94b-2f4e-4d89-8dff-564287c8dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.475805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5da94b-2f4e-4d89-8dff-564287c8dd08 admin admin] PATH_INFO: `/v3/projects/117fd2a61be54f20909abb2874fe509f/users/bfabe2d52cd14d44a5913f4cdc2e316b/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.490738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5da94b-2f4e-4d89-8dff-564287c8dd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=117fd2a61be54f20909abb2874fe509f, user_id=bfabe2d52cd14d44a5913f4cdc2e316b, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:43.493379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5da94b-2f4e-4d89-8dff-564287c8dd08 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:43.505945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1147/2296] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:43 2022] PUT /identity/v3/projects/117fd2a61be54f20909abb2874fe509f/users/bfabe2d52cd14d44a5913f4cdc2e316b/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:43.516208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b55d65-a6e0-4694-847e-88c60137c45d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.516499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b55d65-a6e0-4694-847e-88c60137c45d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.516782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b55d65-a6e0-4694-847e-88c60137c45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.543214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-13b55d65-a6e0-4694-847e-88c60137c45d None None] MFA Rules not processed for user `bfabe2d52cd14d44a5913f4cdc2e316b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:43.544447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-13b55d65-a6e0-4694-847e-88c60137c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:43.606510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1150/2297] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:43.617740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5da94b-2f4e-4d89-8dff-564287c8dd08 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:43.619469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1f5da94b-2f4e-4d89-8dff-564287c8dd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:43.693205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5da94b-2f4e-4d89-8dff-564287c8dd08 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:43.696777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1e740-a8d1-4847-a853-6a8d5bb95421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:43.697415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1e740-a8d1-4847-a853-6a8d5bb95421 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:43.697699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1e740-a8d1-4847-a853-6a8d5bb95421 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:43.697978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1e740-a8d1-4847-a853-6a8d5bb95421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:43.706128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1e740-a8d1-4847-a853-6a8d5bb95421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:43.707557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1e740-a8d1-4847-a853-6a8d5bb95421 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:43.716153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1148/2298] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:46.690089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b55d65-a6e0-4694-847e-88c60137c45d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:46.756723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b55d65-a6e0-4694-847e-88c60137c45d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:46.762737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:46.763729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:46.764019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:46.764294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] PATH_INFO: `/v3/users/bfabe2d52cd14d44a5913f4cdc2e316b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:46.765495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfabe2d52cd14d44a5913f4cdc2e316b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:46.767499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:46.812071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfabe2d52cd14d44a5913f4cdc2e316b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:46.823939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfabe2d52cd14d44a5913f4cdc2e316b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:46.824555 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfabe2d52cd14d44a5913f4cdc2e316b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:46.831136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfabe2d52cd14d44a5913f4cdc2e316b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:46.838476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfabe2d52cd14d44a5913f4cdc2e316b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:46.844246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1151/2299] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:44:46 2022] DELETE /identity/v3/users/bfabe2d52cd14d44a5913f4cdc2e316b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:46.848615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282954e-4391-4d94-9016-b54544e5e0ab None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:46.849126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282954e-4391-4d94-9016-b54544e5e0ab None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:46.849222 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282954e-4391-4d94-9016-b54544e5e0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:46.866751 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d282954e-4391-4d94-9016-b54544e5e0ab None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:46.867928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d282954e-4391-4d94-9016-b54544e5e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:46.924425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1149/2300] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:46.933859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:46.935353 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:46.992247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecbe49-a068-47a6-9029-a98dbc70907c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:46.996025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798736a2-9187-4b61-89a3-eed1c8e66e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:46.996698 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798736a2-9187-4b61-89a3-eed1c8e66e2c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:46.996998 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798736a2-9187-4b61-89a3-eed1c8e66e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:46.997296 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798736a2-9187-4b61-89a3-eed1c8e66e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.006178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798736a2-9187-4b61-89a3-eed1c8e66e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:47.007598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798736a2-9187-4b61-89a3-eed1c8e66e2c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:47.016716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1152/2301] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:44:47.275018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282954e-4391-4d94-9016-b54544e5e0ab None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:47.276525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d282954e-4391-4d94-9016-b54544e5e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:47.288806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282954e-4391-4d94-9016-b54544e5e0ab None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:47.293618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:47.294540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.294819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.295090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] PATH_INFO: `/v3/projects/117fd2a61be54f20909abb2874fe509f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.296322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=117fd2a61be54f20909abb2874fe509f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:47.298344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:47.344746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117fd2a61be54f20909abb2874fe509f', 'request_id': 'req-10987eaf-1839-45d8-849f-6f69b9244bc8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:47.350675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117fd2a61be54f20909abb2874fe509f', 'request_id': 'req-10987eaf-1839-45d8-849f-6f69b9244bc8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:47.357752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117fd2a61be54f20909abb2874fe509f', 'request_id': 'req-10987eaf-1839-45d8-849f-6f69b9244bc8'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:47.367668 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] The token cache is being invalidate because project 117fd2a61be54f20909abb2874fe509f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:44:47.367947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:47.368557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10987eaf-1839-45d8-849f-6f69b9244bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:44:47.370118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1150/2302] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:44:47 2022] DELETE /identity/v3/projects/117fd2a61be54f20909abb2874fe509f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:47.374905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea70a5-3226-46aa-8db6-10c0c06202fb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.375196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea70a5-3226-46aa-8db6-10c0c06202fb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.375474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea70a5-3226-46aa-8db6-10c0c06202fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.392858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bdea70a5-3226-46aa-8db6-10c0c06202fb None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:47.394082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bdea70a5-3226-46aa-8db6-10c0c06202fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:47.450170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1153/2303] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:47.457670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd65e-4760-4a00-9155-d577503c1cd7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.458657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd65e-4760-4a00-9155-d577503c1cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.458948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd65e-4760-4a00-9155-d577503c1cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.476501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-17cfd65e-4760-4a00-9155-d577503c1cd7 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:47.477937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-17cfd65e-4760-4a00-9155-d577503c1cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:47.485825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1151/2304] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:44:47.490040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea70a5-3226-46aa-8db6-10c0c06202fb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:47.499688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea70a5-3226-46aa-8db6-10c0c06202fb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:47.504194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413640e-f4cf-4eb5-aeb8-593d508bf41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:47.504844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413640e-f4cf-4eb5-aeb8-593d508bf41d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.505611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413640e-f4cf-4eb5-aeb8-593d508bf41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.505881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413640e-f4cf-4eb5-aeb8-593d508bf41d admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.506652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413640e-f4cf-4eb5-aeb8-593d508bf41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:44:47.506940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413640e-f4cf-4eb5-aeb8-593d508bf41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:47.508534 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413640e-f4cf-4eb5-aeb8-593d508bf41d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:47.520008 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1154/2305] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:44:47.524926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfd65e-4760-4a00-9155-d577503c1cd7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:47.533983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfd65e-4760-4a00-9155-d577503c1cd7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:47.538817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b5bb-586b-4235-be7d-957cb51751ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:47.539450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b5bb-586b-4235-be7d-957cb51751ba admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.539726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b5bb-586b-4235-be7d-957cb51751ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.539996 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b5bb-586b-4235-be7d-957cb51751ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.540697 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12b5bb-586b-4235-be7d-957cb51751ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:47.542630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12b5bb-586b-4235-be7d-957cb51751ba admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:47.570725 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1152/2306] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:44:47 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:44:47.571830 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413640e-f4cf-4eb5-aeb8-593d508bf41d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:47.581496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413640e-f4cf-4eb5-aeb8-593d508bf41d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:47.641455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862cc75-40c0-4f34-b59d-cd7495a0952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:47.642503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862cc75-40c0-4f34-b59d-cd7495a0952f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.642787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862cc75-40c0-4f34-b59d-cd7495a0952f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.643060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862cc75-40c0-4f34-b59d-cd7495a0952f admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.643752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862cc75-40c0-4f34-b59d-cd7495a0952f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:47.645673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862cc75-40c0-4f34-b59d-cd7495a0952f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:47.669481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1155/2307] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:44:47 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:44:47.673471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b5bb-586b-4235-be7d-957cb51751ba admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:47.684136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b5bb-586b-4235-be7d-957cb51751ba admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:47.688720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615c467-30d3-4dc4-a709-442710b436a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:47.689366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615c467-30d3-4dc4-a709-442710b436a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.689643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615c467-30d3-4dc4-a709-442710b436a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.689913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615c467-30d3-4dc4-a709-442710b436a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.690664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615c467-30d3-4dc4-a709-442710b436a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:47.692278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615c467-30d3-4dc4-a709-442710b436a4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:47.702482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1153/2308] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:47.706408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862cc75-40c0-4f34-b59d-cd7495a0952f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:47.717103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862cc75-40c0-4f34-b59d-cd7495a0952f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:47.722675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dca6d5-166c-41a7-9acb-e4d228406a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:47.723337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca6d5-166c-41a7-9acb-e4d228406a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.723614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca6d5-166c-41a7-9acb-e4d228406a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.723965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca6d5-166c-41a7-9acb-e4d228406a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.724689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dca6d5-166c-41a7-9acb-e4d228406a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:47.726422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dca6d5-166c-41a7-9acb-e4d228406a85 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:47.738065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1156/2309] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:44:47.742637 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615c467-30d3-4dc4-a709-442710b436a4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:47.752534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615c467-30d3-4dc4-a709-442710b436a4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:47.758055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3c7a9-9b50-4195-8a49-d5dc50e287f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:47.758950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3c7a9-9b50-4195-8a49-d5dc50e287f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.759232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3c7a9-9b50-4195-8a49-d5dc50e287f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.759508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3c7a9-9b50-4195-8a49-d5dc50e287f9 admin admin] PATH_INFO: `/v3/projects/cf6cd3866d784a8fadd34d97e3200da6/users/545de3ac9da34243be528cff9b275f41/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.783621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3c7a9-9b50-4195-8a49-d5dc50e287f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6cd3866d784a8fadd34d97e3200da6, user_id=545de3ac9da34243be528cff9b275f41, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:47.786472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3c7a9-9b50-4195-8a49-d5dc50e287f9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:47.800472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1154/2310] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:44:47 2022] PUT /identity/v3/projects/cf6cd3866d784a8fadd34d97e3200da6/users/545de3ac9da34243be528cff9b275f41/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:44:47.819744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d5bc-77bc-46d3-9cef-a649b1f584c4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.820038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d5bc-77bc-46d3-9cef-a649b1f584c4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.820317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d5bc-77bc-46d3-9cef-a649b1f584c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:47.854389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4596d5bc-77bc-46d3-9cef-a649b1f584c4 None None] MFA Rules not processed for user `545de3ac9da34243be528cff9b275f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:44:47.855675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4596d5bc-77bc-46d3-9cef-a649b1f584c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:47.918195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1157/2311] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:44:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:44:47.929336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3c7a9-9b50-4195-8a49-d5dc50e287f9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:44:47.931186 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ddc3c7a9-9b50-4195-8a49-d5dc50e287f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:44:47.993645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3c7a9-9b50-4195-8a49-d5dc50e287f9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:44:47.997828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10e492-543f-42bb-b23e-1aa7960080a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:44:47.998652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10e492-543f-42bb-b23e-1aa7960080a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:44:47.999002 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10e492-543f-42bb-b23e-1aa7960080a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:44:47.999368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10e492-543f-42bb-b23e-1aa7960080a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:44:48.008768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10e492-543f-42bb-b23e-1aa7960080a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:44:48.010469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10e492-543f-42bb-b23e-1aa7960080a3 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:44:48.019665 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1155/2312] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:44:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:45:06.116172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d7258-7459-46a3-bb37-10f68b5a0d41 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:06.116649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d7258-7459-46a3-bb37-10f68b5a0d41 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:06.116746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d7258-7459-46a3-bb37-10f68b5a0d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:06.175431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7f6d7258-7459-46a3-bb37-10f68b5a0d41 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:06.176625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f6d7258-7459-46a3-bb37-10f68b5a0d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:06.256935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1158/2313] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:45:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:06.302541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10e492-543f-42bb-b23e-1aa7960080a3 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:06.303980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aa10e492-543f-42bb-b23e-1aa7960080a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:06.392439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10e492-543f-42bb-b23e-1aa7960080a3 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:06.397993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec913f2-6e01-499d-bea3-80bc3638ad8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:06.398737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec913f2-6e01-499d-bea3-80bc3638ad8e service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:06.399057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec913f2-6e01-499d-bea3-80bc3638ad8e service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:06.399338 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec913f2-6e01-499d-bea3-80bc3638ad8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:06.407922 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec913f2-6e01-499d-bea3-80bc3638ad8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:06.409524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec913f2-6e01-499d-bea3-80bc3638ad8e service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:06.418662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1156/2314] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:45:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:45:10.478092 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d7258-7459-46a3-bb37-10f68b5a0d41 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:10.479874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f6d7258-7459-46a3-bb37-10f68b5a0d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:10.615666 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d7258-7459-46a3-bb37-10f68b5a0d41 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:10.634768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b414eee-189d-4f1d-9430-66f3aa68352e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:10.635999 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b414eee-189d-4f1d-9430-66f3aa68352e service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:10.636665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b414eee-189d-4f1d-9430-66f3aa68352e service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:10.637197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b414eee-189d-4f1d-9430-66f3aa68352e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:10.640119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8b414eee-189d-4f1d-9430-66f3aa68352e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:10.656297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b414eee-189d-4f1d-9430-66f3aa68352e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:10.660066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b414eee-189d-4f1d-9430-66f3aa68352e service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:10.674341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1159/2315] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:45:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:45:12.349892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44dad8-d30b-41a9-ab3b-94c880869895 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:12.350427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44dad8-d30b-41a9-ab3b-94c880869895 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:12.350507 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44dad8-d30b-41a9-ab3b-94c880869895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:12.427380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9b44dad8-d30b-41a9-ab3b-94c880869895 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:12.429063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9b44dad8-d30b-41a9-ab3b-94c880869895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:12.438090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1157/2316] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:12.485469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b414eee-189d-4f1d-9430-66f3aa68352e service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:12.506167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b414eee-189d-4f1d-9430-66f3aa68352e service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:12.518469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becab227-fa15-468c-b7fd-f5880cbe6163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:12.520568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becab227-fa15-468c-b7fd-f5880cbe6163 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:12.521737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becab227-fa15-468c-b7fd-f5880cbe6163 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:12.522616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becab227-fa15-468c-b7fd-f5880cbe6163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:12.537559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becab227-fa15-468c-b7fd-f5880cbe6163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:12.541514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becab227-fa15-468c-b7fd-f5880cbe6163 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:12.552760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1160/2317] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:45:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:45:13.193437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1853e-f96c-4a5c-bf92-f1a3f2a389d9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:13.193858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1853e-f96c-4a5c-bf92-f1a3f2a389d9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:13.194551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1853e-f96c-4a5c-bf92-f1a3f2a389d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:13.218478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a0d1853e-f96c-4a5c-bf92-f1a3f2a389d9 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:13.220101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a0d1853e-f96c-4a5c-bf92-f1a3f2a389d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:13.233598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1158/2318] 10.222.0.75 () {58 vars in 967 bytes} [Tue May 17 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:13.246745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becab227-fa15-468c-b7fd-f5880cbe6163 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:13.265200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becab227-fa15-468c-b7fd-f5880cbe6163 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:13.272942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1ec38-4d56-4307-92c9-467bf49b7e31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:13.273764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1ec38-4d56-4307-92c9-467bf49b7e31 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:13.274081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1ec38-4d56-4307-92c9-467bf49b7e31 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:13.274488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1ec38-4d56-4307-92c9-467bf49b7e31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:13.286260 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1ec38-4d56-4307-92c9-467bf49b7e31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:13.288337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1ec38-4d56-4307-92c9-467bf49b7e31 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:13.297317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1161/2319] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:45:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:45:13.617154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd01d-d4c1-48f7-b8b6-d5c3dce2acd1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:13.617714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd01d-d4c1-48f7-b8b6-d5c3dce2acd1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:13.617810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd01d-d4c1-48f7-b8b6-d5c3dce2acd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:13.637074 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fd3bd01d-d4c1-48f7-b8b6-d5c3dce2acd1 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:13.638477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fd3bd01d-d4c1-48f7-b8b6-d5c3dce2acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:13.646121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1159/2320] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:13.664491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1ec38-4d56-4307-92c9-467bf49b7e31 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:13.684703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1ec38-4d56-4307-92c9-467bf49b7e31 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:13.685895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c42d24-e529-4f10-a72f-005ce089133b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:13.686731 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c42d24-e529-4f10-a72f-005ce089133b service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:13.687123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c42d24-e529-4f10-a72f-005ce089133b service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:13.687434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c42d24-e529-4f10-a72f-005ce089133b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:13.697537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c42d24-e529-4f10-a72f-005ce089133b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:13.699353 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c42d24-e529-4f10-a72f-005ce089133b service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:13.709125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1162/2321] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:45:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:45:14.176350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6afca-0e03-48e8-aa4b-c75dfa3f3d62 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:14.176694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6afca-0e03-48e8-aa4b-c75dfa3f3d62 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:14.177014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6afca-0e03-48e8-aa4b-c75dfa3f3d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:14.198048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dbc6afca-0e03-48e8-aa4b-c75dfa3f3d62 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:14.199496 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dbc6afca-0e03-48e8-aa4b-c75dfa3f3d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:14.214228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1160/2322] 10.222.0.75 () {58 vars in 967 bytes} [Tue May 17 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:45:14.224918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c42d24-e529-4f10-a72f-005ce089133b service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:14.237829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c42d24-e529-4f10-a72f-005ce089133b service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:14.244760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0617a5-53e9-470d-b09e-7f0b7953fcb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:14.245809 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0617a5-53e9-470d-b09e-7f0b7953fcb6 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:14.246398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0617a5-53e9-470d-b09e-7f0b7953fcb6 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:14.246927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0617a5-53e9-470d-b09e-7f0b7953fcb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:14.258664 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0617a5-53e9-470d-b09e-7f0b7953fcb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:14.261414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0617a5-53e9-470d-b09e-7f0b7953fcb6 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:14.273471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1163/2323] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:45:15.588330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0089bf-561c-4cd9-b3be-e734c9dbf7c9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:15.588800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0089bf-561c-4cd9-b3be-e734c9dbf7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:15.588973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0089bf-561c-4cd9-b3be-e734c9dbf7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:15.620506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9c0089bf-561c-4cd9-b3be-e734c9dbf7c9 None None] MFA Rules not processed for user `b40c7b11fff443fa8c78e8647703e230`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:15.622534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9c0089bf-561c-4cd9-b3be-e734c9dbf7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:15.717676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1161/2324] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:16.915499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0617a5-53e9-470d-b09e-7f0b7953fcb6 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:16.982435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0089bf-561c-4cd9-b3be-e734c9dbf7c9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:16.983944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9c0089bf-561c-4cd9-b3be-e734c9dbf7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:16.993514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0617a5-53e9-470d-b09e-7f0b7953fcb6 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:16.999348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0089bf-561c-4cd9-b3be-e734c9dbf7c9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:16.999491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:17.000336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:17.000614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:17.001167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] PATH_INFO: `/v3/users/545de3ac9da34243be528cff9b275f41` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:17.002472 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] RBAC: Authorizing `identity:delete_user(user_id=545de3ac9da34243be528cff9b275f41)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:17.003933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:17.004858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:17.004999 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:17.005147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:17.005572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] PATH_INFO: `/v3/users/b860a94349204b7d86ad796882dcd402` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:17.006977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b860a94349204b7d86ad796882dcd402)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:17.009223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:17.067258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b860a94349204b7d86ad796882dcd402'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.077281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545de3ac9da34243be528cff9b275f41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.081353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b860a94349204b7d86ad796882dcd402'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.083134 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b860a94349204b7d86ad796882dcd402'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.084197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b860a94349204b7d86ad796882dcd402'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.092298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e3289740-2470-42ff-8525-3cb2e58363d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b860a94349204b7d86ad796882dcd402'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.100431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545de3ac9da34243be528cff9b275f41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.101461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545de3ac9da34243be528cff9b275f41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.108676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1162/2325] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:45:16 2022] DELETE /identity/v3/users/b860a94349204b7d86ad796882dcd402 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:45:17.111583 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545de3ac9da34243be528cff9b275f41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.116809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34cef3-48a8-40b9-9130-f2d22a033ae8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:17.118318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34cef3-48a8-40b9-9130-f2d22a033ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:17.118906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34cef3-48a8-40b9-9130-f2d22a033ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:17.122481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8d75d6f6-57bc-4447-b002-0320b0ac203e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545de3ac9da34243be528cff9b275f41'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.147783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1164/2326] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:45:16 2022] DELETE /identity/v3/users/545de3ac9da34243be528cff9b275f41 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:45:17.149795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16bf86-4e9b-4b7e-9a75-83907e0e8c1e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:17.150308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ed34cef3-48a8-40b9-9130-f2d22a033ae8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:17.150428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16bf86-4e9b-4b7e-9a75-83907e0e8c1e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:17.150807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16bf86-4e9b-4b7e-9a75-83907e0e8c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:17.152184 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ed34cef3-48a8-40b9-9130-f2d22a033ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:17.206600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fa16bf86-4e9b-4b7e-9a75-83907e0e8c1e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:17.210240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fa16bf86-4e9b-4b7e-9a75-83907e0e8c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:17.239577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1163/2327] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:17.245081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34cef3-48a8-40b9-9130-f2d22a033ae8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:17.247959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ed34cef3-48a8-40b9-9130-f2d22a033ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:17.303717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1165/2328] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:17.314261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16bf86-4e9b-4b7e-9a75-83907e0e8c1e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:17.321882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34cef3-48a8-40b9-9130-f2d22a033ae8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:17.325463 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b7286-6cf5-4032-822e-04a597631b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:17.326308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b7286-6cf5-4032-822e-04a597631b27 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:17.326707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b7286-6cf5-4032-822e-04a597631b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:17.327266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b7286-6cf5-4032-822e-04a597631b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:17.331868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16bf86-4e9b-4b7e-9a75-83907e0e8c1e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:17.338613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b7286-6cf5-4032-822e-04a597631b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:17.340239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b7286-6cf5-4032-822e-04a597631b27 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:17.341619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8c898-b34e-4b7c-a71e-6a202833f518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:17.343182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8c898-b34e-4b7c-a71e-6a202833f518 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:17.343484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8c898-b34e-4b7c-a71e-6a202833f518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:17.343764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8c898-b34e-4b7c-a71e-6a202833f518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:17.350998 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1164/2329] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:45:17.358156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8c898-b34e-4b7c-a71e-6a202833f518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:17.359716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8c898-b34e-4b7c-a71e-6a202833f518 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:17.370063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1166/2330] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:45:17.687476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b7286-6cf5-4032-822e-04a597631b27 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:17.690490 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-832b7286-6cf5-4032-822e-04a597631b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:17.741595 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b7286-6cf5-4032-822e-04a597631b27 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:17.754778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:17.756048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:17.756645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:17.757118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] PATH_INFO: `/v3/projects/29ff5f34a5094ef9a5c8c4b5b924415b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:17.758902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ff5f34a5094ef9a5c8c4b5b924415b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:17.764154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:17.787304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8c898-b34e-4b7c-a71e-6a202833f518 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:17.788915 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4ac8c898-b34e-4b7c-a71e-6a202833f518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:17.805492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8c898-b34e-4b7c-a71e-6a202833f518 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:17.810885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:17.811872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:17.812064 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:17.812339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] PATH_INFO: `/v3/projects/cf6cd3866d784a8fadd34d97e3200da6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:17.813546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6cd3866d784a8fadd34d97e3200da6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:17.815544 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:17.864726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ff5f34a5094ef9a5c8c4b5b924415b', 'request_id': 'req-1ef48703-f57a-4366-b358-16cc31d24b76'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.872373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ff5f34a5094ef9a5c8c4b5b924415b', 'request_id': 'req-1ef48703-f57a-4366-b358-16cc31d24b76'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.882875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ff5f34a5094ef9a5c8c4b5b924415b', 'request_id': 'req-1ef48703-f57a-4366-b358-16cc31d24b76'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.896987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] The token cache is being invalidate because project 29ff5f34a5094ef9a5c8c4b5b924415b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:45:17.897372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.898119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1ef48703-f57a-4366-b358-16cc31d24b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.899991 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1165/2331] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:45:17 2022] DELETE /identity/v3/projects/29ff5f34a5094ef9a5c8c4b5b924415b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:45:17.914816 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6cd3866d784a8fadd34d97e3200da6', 'request_id': 'req-d544e13b-7ac5-4675-bde9-b88da62510c5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.929992 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6cd3866d784a8fadd34d97e3200da6', 'request_id': 'req-d544e13b-7ac5-4675-bde9-b88da62510c5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.947693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6cd3866d784a8fadd34d97e3200da6', 'request_id': 'req-d544e13b-7ac5-4675-bde9-b88da62510c5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.965214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] The token cache is being invalidate because project cf6cd3866d784a8fadd34d97e3200da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:45:17.966052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.966531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d544e13b-7ac5-4675-bde9-b88da62510c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:17.968237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1167/2332] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:45:17 2022] DELETE /identity/v3/projects/cf6cd3866d784a8fadd34d97e3200da6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:45:17.973818 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37272c-72b2-45e4-b734-51b085eb43b3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:17.974279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37272c-72b2-45e4-b734-51b085eb43b3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:17.974708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37272c-72b2-45e4-b734-51b085eb43b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.005913 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7f37272c-72b2-45e4-b734-51b085eb43b3 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:18.010212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7f37272c-72b2-45e4-b734-51b085eb43b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:18.097170 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1166/2333] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:18.105041 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ed30-91bb-45aa-94fd-0df42913a596 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:18.105477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ed30-91bb-45aa-94fd-0df42913a596 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:18.105847 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ed30-91bb-45aa-94fd-0df42913a596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.131629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b899ed30-91bb-45aa-94fd-0df42913a596 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:18.132918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b899ed30-91bb-45aa-94fd-0df42913a596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:18.145107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1168/2334] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:18.146256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37272c-72b2-45e4-b734-51b085eb43b3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:18.159676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37272c-72b2-45e4-b734-51b085eb43b3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:18.180676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39aa74-a308-4ff7-bbd3-8c7451510c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:18.181419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39aa74-a308-4ff7-bbd3-8c7451510c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:18.181724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39aa74-a308-4ff7-bbd3-8c7451510c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:18.182014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39aa74-a308-4ff7-bbd3-8c7451510c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.182779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39aa74-a308-4ff7-bbd3-8c7451510c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:45:18.183087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39aa74-a308-4ff7-bbd3-8c7451510c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:18.184729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39aa74-a308-4ff7-bbd3-8c7451510c7c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:18.200359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1167/2335] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:45:18.205262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899ed30-91bb-45aa-94fd-0df42913a596 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:18.216086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899ed30-91bb-45aa-94fd-0df42913a596 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:18.221256 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a665fdf-f492-4b1d-8b90-0d352f1b4b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:18.222016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a665fdf-f492-4b1d-8b90-0d352f1b4b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:18.222372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a665fdf-f492-4b1d-8b90-0d352f1b4b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:18.223268 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a665fdf-f492-4b1d-8b90-0d352f1b4b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.224022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a665fdf-f492-4b1d-8b90-0d352f1b4b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:18.226043 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a665fdf-f492-4b1d-8b90-0d352f1b4b1a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:18.263944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1169/2336] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:45:18 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:45:18.268141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39aa74-a308-4ff7-bbd3-8c7451510c7c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:18.279864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39aa74-a308-4ff7-bbd3-8c7451510c7c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:18.372728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf721442-f7ac-4fc2-a15b-260ef87a04d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:18.373540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf721442-f7ac-4fc2-a15b-260ef87a04d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:18.373969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf721442-f7ac-4fc2-a15b-260ef87a04d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:18.374406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf721442-f7ac-4fc2-a15b-260ef87a04d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.375141 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf721442-f7ac-4fc2-a15b-260ef87a04d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:18.377300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf721442-f7ac-4fc2-a15b-260ef87a04d0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:18.411421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1168/2337] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:45:18 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:45:18.412513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a665fdf-f492-4b1d-8b90-0d352f1b4b1a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:18.425528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a665fdf-f492-4b1d-8b90-0d352f1b4b1a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:18.431788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479f8b8-1ecc-4234-b9f6-90e9a601c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:18.433132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479f8b8-1ecc-4234-b9f6-90e9a601c936 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:18.433493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479f8b8-1ecc-4234-b9f6-90e9a601c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:18.433836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479f8b8-1ecc-4234-b9f6-90e9a601c936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.434669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479f8b8-1ecc-4234-b9f6-90e9a601c936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:18.436334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479f8b8-1ecc-4234-b9f6-90e9a601c936 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:18.451150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1170/2338] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:45:18.452956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf721442-f7ac-4fc2-a15b-260ef87a04d0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:18.465508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf721442-f7ac-4fc2-a15b-260ef87a04d0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:18.471632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180413a-58eb-4c2b-8d47-12964a7e07ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:18.473436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180413a-58eb-4c2b-8d47-12964a7e07ad admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:18.474420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180413a-58eb-4c2b-8d47-12964a7e07ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:18.474786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180413a-58eb-4c2b-8d47-12964a7e07ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.475680 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180413a-58eb-4c2b-8d47-12964a7e07ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:18.478264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180413a-58eb-4c2b-8d47-12964a7e07ad admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:18.492696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1169/2339] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:45:18.494309 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479f8b8-1ecc-4234-b9f6-90e9a601c936 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:18.509362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479f8b8-1ecc-4234-b9f6-90e9a601c936 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:18.514786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643eaa7-b626-406b-b2a5-d201dff5ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:18.515701 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643eaa7-b626-406b-b2a5-d201dff5ff9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:18.516030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643eaa7-b626-406b-b2a5-d201dff5ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:18.516303 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643eaa7-b626-406b-b2a5-d201dff5ff9b admin admin] PATH_INFO: `/v3/projects/4f8e659223ca4c2a8f4c6836e6a1cc18/users/7b0e466b56814e10a27304db1bb7b262/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.532489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643eaa7-b626-406b-b2a5-d201dff5ff9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8e659223ca4c2a8f4c6836e6a1cc18, user_id=7b0e466b56814e10a27304db1bb7b262, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:18.535812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643eaa7-b626-406b-b2a5-d201dff5ff9b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:18.551965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1171/2340] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:45:18 2022] PUT /identity/v3/projects/4f8e659223ca4c2a8f4c6836e6a1cc18/users/7b0e466b56814e10a27304db1bb7b262/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:45:18.557298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06200066-bfcc-4729-989f-1590424409f5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:18.557831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06200066-bfcc-4729-989f-1590424409f5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:18.558196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06200066-bfcc-4729-989f-1590424409f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.578333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-06200066-bfcc-4729-989f-1590424409f5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:18.579906 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-06200066-bfcc-4729-989f-1590424409f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:18.642178 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1170/2341] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:18.659877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643eaa7-b626-406b-b2a5-d201dff5ff9b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:18.662142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2643eaa7-b626-406b-b2a5-d201dff5ff9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:18.758304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643eaa7-b626-406b-b2a5-d201dff5ff9b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:18.762749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae53dc-ca6e-4b8c-a552-e2e451e256b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:18.763780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae53dc-ca6e-4b8c-a552-e2e451e256b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:18.764071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae53dc-ca6e-4b8c-a552-e2e451e256b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:18.764364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae53dc-ca6e-4b8c-a552-e2e451e256b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:18.785586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae53dc-ca6e-4b8c-a552-e2e451e256b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:18.787120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae53dc-ca6e-4b8c-a552-e2e451e256b0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:18.808882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1172/2342] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:45:24.694770 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3db52c-c0d6-4a64-ab24-404c8653749d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:24.695805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3db52c-c0d6-4a64-ab24-404c8653749d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:24.696483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3db52c-c0d6-4a64-ab24-404c8653749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:24.735591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6a3db52c-c0d6-4a64-ab24-404c8653749d None None] MFA Rules not processed for user `7b0e466b56814e10a27304db1bb7b262`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:24.736834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6a3db52c-c0d6-4a64-ab24-404c8653749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:24.854052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1171/2343] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:24.858248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae53dc-ca6e-4b8c-a552-e2e451e256b0 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:24.869727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae53dc-ca6e-4b8c-a552-e2e451e256b0 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:24.875973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed77836-0bdd-4657-ad85-7856549c63ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:24.876633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77836-0bdd-4657-ad85-7856549c63ec admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:24.877119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77836-0bdd-4657-ad85-7856549c63ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:24.878236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77836-0bdd-4657-ad85-7856549c63ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:24.878329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed77836-0bdd-4657-ad85-7856549c63ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:24.880769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed77836-0bdd-4657-ad85-7856549c63ec admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:24.912979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1173/2344] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:45:24 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:45:24.916976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3db52c-c0d6-4a64-ab24-404c8653749d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:24.928558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3db52c-c0d6-4a64-ab24-404c8653749d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:25.000816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701be2da-6f3d-4023-befe-67ea22e7c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:25.001508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701be2da-6f3d-4023-befe-67ea22e7c832 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:25.001788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701be2da-6f3d-4023-befe-67ea22e7c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:25.002100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701be2da-6f3d-4023-befe-67ea22e7c832 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:25.002800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701be2da-6f3d-4023-befe-67ea22e7c832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:25.005330 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701be2da-6f3d-4023-befe-67ea22e7c832 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:25.026849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1172/2345] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:45:24 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:45:25.030963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed77836-0bdd-4657-ad85-7856549c63ec admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:25.048015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed77836-0bdd-4657-ad85-7856549c63ec admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:25.053639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dbff0-6c7a-47e3-a010-5c7849b6c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:25.054379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbff0-6c7a-47e3-a010-5c7849b6c726 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:25.054669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbff0-6c7a-47e3-a010-5c7849b6c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:25.054951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbff0-6c7a-47e3-a010-5c7849b6c726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:25.055724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dbff0-6c7a-47e3-a010-5c7849b6c726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:25.057642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dbff0-6c7a-47e3-a010-5c7849b6c726 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:25.073766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1174/2346] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:45:25.078148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701be2da-6f3d-4023-befe-67ea22e7c832 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:25.088778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701be2da-6f3d-4023-befe-67ea22e7c832 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:25.097598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd222e-48a0-41bd-8e61-96755eef0bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:25.098541 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd222e-48a0-41bd-8e61-96755eef0bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:25.098824 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd222e-48a0-41bd-8e61-96755eef0bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:25.099096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd222e-48a0-41bd-8e61-96755eef0bf0 admin admin] PATH_INFO: `/v3/projects/2880acf32f0e4e73a9996d9e2a5ada7d/users/82e4f8ae6ed3407980fb69efcd3fc463/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:25.118528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd222e-48a0-41bd-8e61-96755eef0bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2880acf32f0e4e73a9996d9e2a5ada7d, user_id=82e4f8ae6ed3407980fb69efcd3fc463, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:25.123512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd222e-48a0-41bd-8e61-96755eef0bf0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:25.137899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1173/2347] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:45:25 2022] PUT /identity/v3/projects/2880acf32f0e4e73a9996d9e2a5ada7d/users/82e4f8ae6ed3407980fb69efcd3fc463/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:45:25.148552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dbff0-6c7a-47e3-a010-5c7849b6c726 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:25.159696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dbff0-6c7a-47e3-a010-5c7849b6c726 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:25.247088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5040dc9-7a40-4ae8-8cf6-a432c9144607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:25.247769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5040dc9-7a40-4ae8-8cf6-a432c9144607 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:25.248184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5040dc9-7a40-4ae8-8cf6-a432c9144607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:25.248467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5040dc9-7a40-4ae8-8cf6-a432c9144607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:25.249253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5040dc9-7a40-4ae8-8cf6-a432c9144607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:25.250892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5040dc9-7a40-4ae8-8cf6-a432c9144607 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:25.261874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1175/2348] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:45:25.265894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd222e-48a0-41bd-8e61-96755eef0bf0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:25.277379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd222e-48a0-41bd-8e61-96755eef0bf0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:25.282164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958194-cd6b-4fce-a0d9-0fb70b7a6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:25.283834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958194-cd6b-4fce-a0d9-0fb70b7a6205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:25.283834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958194-cd6b-4fce-a0d9-0fb70b7a6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:25.283834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958194-cd6b-4fce-a0d9-0fb70b7a6205 admin admin] PATH_INFO: `/v3/projects/2880acf32f0e4e73a9996d9e2a5ada7d/users/82e4f8ae6ed3407980fb69efcd3fc463/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:25.285639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee958194-cd6b-4fce-a0d9-0fb70b7a6205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2880acf32f0e4e73a9996d9e2a5ada7d, user_id=82e4f8ae6ed3407980fb69efcd3fc463, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:25.288300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee958194-cd6b-4fce-a0d9-0fb70b7a6205 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:25.299633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1174/2349] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:45:25 2022] PUT /identity/v3/projects/2880acf32f0e4e73a9996d9e2a5ada7d/users/82e4f8ae6ed3407980fb69efcd3fc463/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:45:26.562824 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996305fc-152b-44ca-afd4-d3917cd6b038 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:26.563744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996305fc-152b-44ca-afd4-d3917cd6b038 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:26.564221 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996305fc-152b-44ca-afd4-d3917cd6b038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:26.585009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-996305fc-152b-44ca-afd4-d3917cd6b038 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:26.586595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-996305fc-152b-44ca-afd4-d3917cd6b038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:26.658785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1176/2350] 10.222.0.75 () {58 vars in 967 bytes} [Tue May 17 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:26.674831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958194-cd6b-4fce-a0d9-0fb70b7a6205 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:26.677710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ee958194-cd6b-4fce-a0d9-0fb70b7a6205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:26.768711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958194-cd6b-4fce-a0d9-0fb70b7a6205 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:26.776691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c295d-b55a-4562-9b7e-d185dbd85236 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:26.777584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c295d-b55a-4562-9b7e-d185dbd85236 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:26.778063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c295d-b55a-4562-9b7e-d185dbd85236 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:26.778485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c295d-b55a-4562-9b7e-d185dbd85236 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:26.787373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c295d-b55a-4562-9b7e-d185dbd85236 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:26.789127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c295d-b55a-4562-9b7e-d185dbd85236 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:26.797802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1175/2351] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:45:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:45:29.298746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996305fc-152b-44ca-afd4-d3917cd6b038 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:29.301163 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-996305fc-152b-44ca-afd4-d3917cd6b038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:29.422364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996305fc-152b-44ca-afd4-d3917cd6b038 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:29.428228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:29.429401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:29.429863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:29.430322 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] PATH_INFO: `/v3/users/8f0f8ee6e0d24c749a405850ba15f560` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:29.431801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0f8ee6e0d24c749a405850ba15f560)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:29.434235 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:29.521027 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0f8ee6e0d24c749a405850ba15f560'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:29.536485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0f8ee6e0d24c749a405850ba15f560'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:29.537286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0f8ee6e0d24c749a405850ba15f560'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:29.554495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0f8ee6e0d24c749a405850ba15f560'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:29.565273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-547ce0e5-2f7b-4319-8920-1b4da72ef95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0f8ee6e0d24c749a405850ba15f560'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:29.577668 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1177/2352] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:45:29 2022] DELETE /identity/v3/users/8f0f8ee6e0d24c749a405850ba15f560 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:45:29.877214 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c295d-b55a-4562-9b7e-d185dbd85236 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:29.900942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c295d-b55a-4562-9b7e-d185dbd85236 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:30.032766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:30.033651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.033943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.034550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] PATH_INFO: `/v3/projects/cac36e5078db4023a88b7720e409780b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.036353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac36e5078db4023a88b7720e409780b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:30.038305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:30.121778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac36e5078db4023a88b7720e409780b', 'request_id': 'req-847a203b-837f-498d-92a0-313a29b3eb33'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:30.135453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac36e5078db4023a88b7720e409780b', 'request_id': 'req-847a203b-837f-498d-92a0-313a29b3eb33'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:30.154164 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac36e5078db4023a88b7720e409780b', 'request_id': 'req-847a203b-837f-498d-92a0-313a29b3eb33'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:30.179777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] The token cache is being invalidate because project cac36e5078db4023a88b7720e409780b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:45:30.180240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:30.180945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-847a203b-837f-498d-92a0-313a29b3eb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:45:30.188655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1176/2353] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:45:29 2022] DELETE /identity/v3/projects/cac36e5078db4023a88b7720e409780b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:45:30.190351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad4c20-68bf-4c36-8174-6bd8ae144d2f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.190727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad4c20-68bf-4c36-8174-6bd8ae144d2f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.190925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad4c20-68bf-4c36-8174-6bd8ae144d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.229742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-10ad4c20-68bf-4c36-8174-6bd8ae144d2f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:30.237352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-10ad4c20-68bf-4c36-8174-6bd8ae144d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:30.326312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1178/2354] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:30.335409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1539b6-fd1e-4f93-abd5-dfd4e970e0fe None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.335699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1539b6-fd1e-4f93-abd5-dfd4e970e0fe None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.335972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1539b6-fd1e-4f93-abd5-dfd4e970e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.361627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ab1539b6-fd1e-4f93-abd5-dfd4e970e0fe None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:30.363011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab1539b6-fd1e-4f93-abd5-dfd4e970e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:30.379794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1177/2355] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:30.393831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad4c20-68bf-4c36-8174-6bd8ae144d2f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:30.418459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad4c20-68bf-4c36-8174-6bd8ae144d2f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:30.424606 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aeab7-51bf-4088-b430-1b72a7f61cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:30.425598 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aeab7-51bf-4088-b430-1b72a7f61cfa admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.426070 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aeab7-51bf-4088-b430-1b72a7f61cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.426556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aeab7-51bf-4088-b430-1b72a7f61cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.427831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694aeab7-51bf-4088-b430-1b72a7f61cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:45:30.428347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694aeab7-51bf-4088-b430-1b72a7f61cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:30.430205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694aeab7-51bf-4088-b430-1b72a7f61cfa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:30.445981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1179/2356] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:45:30.450895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1539b6-fd1e-4f93-abd5-dfd4e970e0fe None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:30.467476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1539b6-fd1e-4f93-abd5-dfd4e970e0fe None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:30.473597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b11a6-b37e-475e-b09a-b8fd7d06781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:30.474604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b11a6-b37e-475e-b09a-b8fd7d06781a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.474966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b11a6-b37e-475e-b09a-b8fd7d06781a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.475311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b11a6-b37e-475e-b09a-b8fd7d06781a admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.476013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b11a6-b37e-475e-b09a-b8fd7d06781a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:30.478563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b11a6-b37e-475e-b09a-b8fd7d06781a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:30.519624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1178/2357] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:45:30 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:45:30.523144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aeab7-51bf-4088-b430-1b72a7f61cfa admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:30.536173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aeab7-51bf-4088-b430-1b72a7f61cfa admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:30.604607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245662-2cbe-4b43-a673-224bfbcd3a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:30.605358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245662-2cbe-4b43-a673-224bfbcd3a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.605669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245662-2cbe-4b43-a673-224bfbcd3a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.606025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245662-2cbe-4b43-a673-224bfbcd3a32 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.606724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1245662-2cbe-4b43-a673-224bfbcd3a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:30.609514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1245662-2cbe-4b43-a673-224bfbcd3a32 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:30.633019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1180/2358] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:45:30 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:45:30.636802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b11a6-b37e-475e-b09a-b8fd7d06781a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:30.649289 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b11a6-b37e-475e-b09a-b8fd7d06781a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:30.654645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9171e6a-b916-4448-ad32-5708381c24e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:30.655422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9171e6a-b916-4448-ad32-5708381c24e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.655799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9171e6a-b916-4448-ad32-5708381c24e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.656182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9171e6a-b916-4448-ad32-5708381c24e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.657262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9171e6a-b916-4448-ad32-5708381c24e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:30.659068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9171e6a-b916-4448-ad32-5708381c24e1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:30.674643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1179/2359] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:45:30.675741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245662-2cbe-4b43-a673-224bfbcd3a32 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:30.686978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245662-2cbe-4b43-a673-224bfbcd3a32 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:30.694748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bececc0e-c4bc-49f8-a7bd-20ba3a2db305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:30.695921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bececc0e-c4bc-49f8-a7bd-20ba3a2db305 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.696382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bececc0e-c4bc-49f8-a7bd-20ba3a2db305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.696880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bececc0e-c4bc-49f8-a7bd-20ba3a2db305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.697943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bececc0e-c4bc-49f8-a7bd-20ba3a2db305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:30.700564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bececc0e-c4bc-49f8-a7bd-20ba3a2db305 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:30.725785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1181/2360] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:45:30.726520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9171e6a-b916-4448-ad32-5708381c24e1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:30.740540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9171e6a-b916-4448-ad32-5708381c24e1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:30.747103 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c34bef-45b9-4977-b6a8-b92a84ee5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:30.748422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34bef-45b9-4977-b6a8-b92a84ee5543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.748881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34bef-45b9-4977-b6a8-b92a84ee5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.750494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34bef-45b9-4977-b6a8-b92a84ee5543 admin admin] PATH_INFO: `/v3/projects/5b6c3d661c824f9abc2a4fd6b1f62421/users/8161d658ecbf4d41ac71d16281bdd532/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.770511 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c34bef-45b9-4977-b6a8-b92a84ee5543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6c3d661c824f9abc2a4fd6b1f62421, user_id=8161d658ecbf4d41ac71d16281bdd532, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:30.774450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c34bef-45b9-4977-b6a8-b92a84ee5543 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:30.802414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1180/2361] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:45:30 2022] PUT /identity/v3/projects/5b6c3d661c824f9abc2a4fd6b1f62421/users/8161d658ecbf4d41ac71d16281bdd532/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:45:30.804670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca68c15-6426-4dfb-96a4-0bd6d2f49378 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:30.804960 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca68c15-6426-4dfb-96a4-0bd6d2f49378 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:30.805239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca68c15-6426-4dfb-96a4-0bd6d2f49378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:30.840374 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dca68c15-6426-4dfb-96a4-0bd6d2f49378 None None] MFA Rules not processed for user `8161d658ecbf4d41ac71d16281bdd532`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:30.841667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dca68c15-6426-4dfb-96a4-0bd6d2f49378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:30.955259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1182/2362] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:30.970624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c34bef-45b9-4977-b6a8-b92a84ee5543 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:30.974057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-93c34bef-45b9-4977-b6a8-b92a84ee5543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:31.078877 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c34bef-45b9-4977-b6a8-b92a84ee5543 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:31.089588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfccd96-1409-449c-969d-48475f8fca02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:31.090695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfccd96-1409-449c-969d-48475f8fca02 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:31.091271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfccd96-1409-449c-969d-48475f8fca02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:31.091774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfccd96-1409-449c-969d-48475f8fca02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:31.104858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfccd96-1409-449c-969d-48475f8fca02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:31.106813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfccd96-1409-449c-969d-48475f8fca02 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:31.123712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1181/2363] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:45:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:45:31.161240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b893e33-05b2-4370-a604-fb7e972bbc32 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:31.161765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b893e33-05b2-4370-a604-fb7e972bbc32 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:31.162314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b893e33-05b2-4370-a604-fb7e972bbc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:31.203054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1b893e33-05b2-4370-a604-fb7e972bbc32 None None] MFA Rules not processed for user `82e4f8ae6ed3407980fb69efcd3fc463`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:31.204405 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1b893e33-05b2-4370-a604-fb7e972bbc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:31.378212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1183/2364] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:45:31.383034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfccd96-1409-449c-969d-48475f8fca02 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:45:31.385438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3bfccd96-1409-449c-969d-48475f8fca02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:31.587026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfccd96-1409-449c-969d-48475f8fca02 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:45:31.594724 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53553c-9c55-4d03-92d1-35e417c3b11b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:45:31.595199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53553c-9c55-4d03-92d1-35e417c3b11b service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:31.595483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53553c-9c55-4d03-92d1-35e417c3b11b service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:31.595761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53553c-9c55-4d03-92d1-35e417c3b11b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:31.598362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5b53553c-9c55-4d03-92d1-35e417c3b11b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:31.681546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53553c-9c55-4d03-92d1-35e417c3b11b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:45:31.683441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53553c-9c55-4d03-92d1-35e417c3b11b service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:45:31.706728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1182/2365] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:45:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:45:32.666652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c0546-e1c5-432d-8d89-b51bed2f0145 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:45:32.667462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c0546-e1c5-432d-8d89-b51bed2f0145 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:45:32.667462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c0546-e1c5-432d-8d89-b51bed2f0145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:45:32.689145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-527c0546-e1c5-432d-8d89-b51bed2f0145 None None] MFA Rules not processed for user `7b0e466b56814e10a27304db1bb7b262`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:45:32.690418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-527c0546-e1c5-432d-8d89-b51bed2f0145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:45:32.697900 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1184/2366] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:45:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:46:22.209719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53553c-9c55-4d03-92d1-35e417c3b11b service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:22.268863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53553c-9c55-4d03-92d1-35e417c3b11b service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:22.273313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:22.274311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:22.274591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:22.274863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] PATH_INFO: `/v3/users/8161d658ecbf4d41ac71d16281bdd532` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:22.276032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8161d658ecbf4d41ac71d16281bdd532)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:22.277943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:22.325403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8161d658ecbf4d41ac71d16281bdd532'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.337119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8161d658ecbf4d41ac71d16281bdd532'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.337792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8161d658ecbf4d41ac71d16281bdd532'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.338423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8161d658ecbf4d41ac71d16281bdd532'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.345150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8161d658ecbf4d41ac71d16281bdd532'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.357720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1183/2367] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:46:22 2022] DELETE /identity/v3/users/8161d658ecbf4d41ac71d16281bdd532 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:46:22.362851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f272-8359-466e-8989-bb95e43d19e6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:22.363336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f272-8359-466e-8989-bb95e43d19e6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:22.363443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f272-8359-466e-8989-bb95e43d19e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:22.380902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3a50f272-8359-466e-8989-bb95e43d19e6 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:46:22.382120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3a50f272-8359-466e-8989-bb95e43d19e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:22.437434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1185/2368] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:46:22.447551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:22.449030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:22.503663 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63222c2f-a6e6-4b19-bff0-18f339a44b6f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:22.507316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a1e80-f1e2-4709-b381-ab8e2a0ee1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:22.507948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a1e80-f1e2-4709-b381-ab8e2a0ee1af service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:22.508228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a1e80-f1e2-4709-b381-ab8e2a0ee1af service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:22.508501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a1e80-f1e2-4709-b381-ab8e2a0ee1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:22.517643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a1e80-f1e2-4709-b381-ab8e2a0ee1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:22.519160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a1e80-f1e2-4709-b381-ab8e2a0ee1af service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:22.528768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1184/2369] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:46:22.786237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f272-8359-466e-8989-bb95e43d19e6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:22.787900 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3a50f272-8359-466e-8989-bb95e43d19e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:22.803413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f272-8359-466e-8989-bb95e43d19e6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:22.809925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:22.810879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:22.811231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:22.811564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] PATH_INFO: `/v3/projects/5b6c3d661c824f9abc2a4fd6b1f62421` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:22.812772 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6c3d661c824f9abc2a4fd6b1f62421)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:22.814884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:22.863826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6c3d661c824f9abc2a4fd6b1f62421', 'request_id': 'req-d4ecc2c4-92d3-43fe-9646-48157f959856'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.869958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6c3d661c824f9abc2a4fd6b1f62421', 'request_id': 'req-d4ecc2c4-92d3-43fe-9646-48157f959856'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.877231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6c3d661c824f9abc2a4fd6b1f62421', 'request_id': 'req-d4ecc2c4-92d3-43fe-9646-48157f959856'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.887649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] The token cache is being invalidate because project 5b6c3d661c824f9abc2a4fd6b1f62421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:46:22.887936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.888731 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d4ecc2c4-92d3-43fe-9646-48157f959856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:46:22.890416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1186/2370] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:46:22 2022] DELETE /identity/v3/projects/5b6c3d661c824f9abc2a4fd6b1f62421 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:46:24.286968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a1e80-f1e2-4709-b381-ab8e2a0ee1af service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:24.295386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a1e80-f1e2-4709-b381-ab8e2a0ee1af service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:24.341021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ae4e2-1e1a-4476-8b93-7f31f422be10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:24.341655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ae4e2-1e1a-4476-8b93-7f31f422be10 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:24.341933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ae4e2-1e1a-4476-8b93-7f31f422be10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:24.342236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ae4e2-1e1a-4476-8b93-7f31f422be10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:24.343993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cd8ae4e2-1e1a-4476-8b93-7f31f422be10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:24.404900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ae4e2-1e1a-4476-8b93-7f31f422be10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:24.406555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ae4e2-1e1a-4476-8b93-7f31f422be10 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:24.416710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1185/2371] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:46:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:46:29.946567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1a76-b5d3-447b-a55b-7952f1376421 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:29.947083 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1a76-b5d3-447b-a55b-7952f1376421 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:29.947174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1a76-b5d3-447b-a55b-7952f1376421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:29.965096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-133d1a76-b5d3-447b-a55b-7952f1376421 None None] MFA Rules not processed for user `d099a8ecc77b4259aa30f227ae8f28ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:46:29.966332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-133d1a76-b5d3-447b-a55b-7952f1376421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:30.017461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1187/2372] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:46:37.919660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec7d1e-4d17-4b53-951a-ce7a94788dbf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:37.920218 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec7d1e-4d17-4b53-951a-ce7a94788dbf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:37.920600 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec7d1e-4d17-4b53-951a-ce7a94788dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:37.940530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ecec7d1e-4d17-4b53-951a-ce7a94788dbf None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:46:37.941863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ecec7d1e-4d17-4b53-951a-ce7a94788dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:38.008336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1186/2373] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:46:38.056234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1a76-b5d3-447b-a55b-7952f1376421 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:38.057663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-133d1a76-b5d3-447b-a55b-7952f1376421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:38.125969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1a76-b5d3-447b-a55b-7952f1376421 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:38.131060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faae287-40c0-409f-b517-af3f80ad70dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:38.131704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faae287-40c0-409f-b517-af3f80ad70dd service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:38.131984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faae287-40c0-409f-b517-af3f80ad70dd service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:38.132257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faae287-40c0-409f-b517-af3f80ad70dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:38.145231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faae287-40c0-409f-b517-af3f80ad70dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:38.147681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faae287-40c0-409f-b517-af3f80ad70dd service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:38.156344 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1188/2374] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:46:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:46:52.393957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b4b38-5de0-4d3c-8c6f-9f632e53263e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:52.394579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b4b38-5de0-4d3c-8c6f-9f632e53263e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:52.394579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b4b38-5de0-4d3c-8c6f-9f632e53263e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:52.395882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1187/2375] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:46:52.402102 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5217f58-e4f2-4f00-a86e-0f42d5fbe11b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:52.402581 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5217f58-e4f2-4f00-a86e-0f42d5fbe11b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:52.402681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5217f58-e4f2-4f00-a86e-0f42d5fbe11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:52.438753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b5217f58-e4f2-4f00-a86e-0f42d5fbe11b None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:46:52.440249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b5217f58-e4f2-4f00-a86e-0f42d5fbe11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:52.505363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1189/2376] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:46:52.517749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b4b38-5de0-4d3c-8c6f-9f632e53263e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:52.519470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-052b4b38-5de0-4d3c-8c6f-9f632e53263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:52.598705 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b4b38-5de0-4d3c-8c6f-9f632e53263e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:52.602561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbcabb-1d61-4d4b-b721-42cddb4d161b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22c0e889e1f842b2a6081f38aabd97ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:52.603199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbcabb-1d61-4d4b-b721-42cddb4d161b service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:52.603478 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbcabb-1d61-4d4b-b721-42cddb4d161b service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:52.603749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbcabb-1d61-4d4b-b721-42cddb4d161b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:52.613650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbcabb-1d61-4d4b-b721-42cddb4d161b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:52.615099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbcabb-1d61-4d4b-b721-42cddb4d161b service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:52.625380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1188/2377] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:46:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:46:52.689888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9762f3e-0434-45b0-801c-841bade5c0c7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:52.690206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9762f3e-0434-45b0-801c-841bade5c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:52.690503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9762f3e-0434-45b0-801c-841bade5c0c7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:52.691892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1190/2378] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:46:52.696488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0202a-4712-421c-abea-435a9e447cdf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:52.696780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0202a-4712-421c-abea-435a9e447cdf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:52.697064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0202a-4712-421c-abea-435a9e447cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:52.715768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f1b0202a-4712-421c-abea-435a9e447cdf None None] MFA Rules not processed for user `03e9f522282644e2aad2eefba7509f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:46:52.716961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f1b0202a-4712-421c-abea-435a9e447cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:52.723397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1189/2379] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:46:52.735425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9762f3e-0434-45b0-801c-841bade5c0c7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:52.737065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a9762f3e-0434-45b0-801c-841bade5c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:52.749725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9762f3e-0434-45b0-801c-841bade5c0c7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:52.753754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45237950-9de6-49de-a825-d8d2ff4b24ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:52.754356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45237950-9de6-49de-a825-d8d2ff4b24ac service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:52.754630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45237950-9de6-49de-a825-d8d2ff4b24ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:52.754901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45237950-9de6-49de-a825-d8d2ff4b24ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:52.761675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45237950-9de6-49de-a825-d8d2ff4b24ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:52.763113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45237950-9de6-49de-a825-d8d2ff4b24ac service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:52.771267 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1191/2380] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:46:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:46:52.855101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5870d-753e-4cfb-a3f1-b8db58189f55 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:52.855385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5870d-753e-4cfb-a3f1-b8db58189f55 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:52.855657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5870d-753e-4cfb-a3f1-b8db58189f55 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:52.857085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1190/2381] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:46:52.862025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea152f8e-5631-47ea-b0f0-80ccc837e226 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:52.862319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea152f8e-5631-47ea-b0f0-80ccc837e226 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:52.862597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea152f8e-5631-47ea-b0f0-80ccc837e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:52.883039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ea152f8e-5631-47ea-b0f0-80ccc837e226 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:46:52.884247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ea152f8e-5631-47ea-b0f0-80ccc837e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:52.894145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1192/2382] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:46:52.904519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5870d-753e-4cfb-a3f1-b8db58189f55 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:52.915413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5870d-753e-4cfb-a3f1-b8db58189f55 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:52.919030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa99e1-e615-4177-8fcc-c1e2fdcfb742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:52.919653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa99e1-e615-4177-8fcc-c1e2fdcfb742 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:52.919934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa99e1-e615-4177-8fcc-c1e2fdcfb742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:52.920208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa99e1-e615-4177-8fcc-c1e2fdcfb742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:52.930028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa99e1-e615-4177-8fcc-c1e2fdcfb742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:52.931487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa99e1-e615-4177-8fcc-c1e2fdcfb742 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:52.942393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1191/2383] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:46:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:46:54.752501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea152f8e-5631-47ea-b0f0-80ccc837e226 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:54.761607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea152f8e-5631-47ea-b0f0-80ccc837e226 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:54.765149 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fd8e7-c253-43fd-a05f-e89de0d98406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:54.765782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fd8e7-c253-43fd-a05f-e89de0d98406 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:54.766096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fd8e7-c253-43fd-a05f-e89de0d98406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:54.766371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fd8e7-c253-43fd-a05f-e89de0d98406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:54.768173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-030fd8e7-c253-43fd-a05f-e89de0d98406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:54.782183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fd8e7-c253-43fd-a05f-e89de0d98406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:54.783654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fd8e7-c253-43fd-a05f-e89de0d98406 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:54.794781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1193/2384] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:46:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:46:55.182646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864a9a1-c6e5-408e-bcbd-d602c9d09eeb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:55.183162 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864a9a1-c6e5-408e-bcbd-d602c9d09eeb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:55.183261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864a9a1-c6e5-408e-bcbd-d602c9d09eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:55.203825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e864a9a1-c6e5-408e-bcbd-d602c9d09eeb None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:46:55.205709 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e864a9a1-c6e5-408e-bcbd-d602c9d09eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:55.217200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1192/2385] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:46:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:46:55.230157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fd8e7-c253-43fd-a05f-e89de0d98406 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:55.242218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fd8e7-c253-43fd-a05f-e89de0d98406 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:55.251478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b90dc4-caf9-4b96-a6d6-11bd59bd26b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:55.252455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b90dc4-caf9-4b96-a6d6-11bd59bd26b4 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:55.252908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b90dc4-caf9-4b96-a6d6-11bd59bd26b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:55.253263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b90dc4-caf9-4b96-a6d6-11bd59bd26b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:55.264271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b90dc4-caf9-4b96-a6d6-11bd59bd26b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:55.265854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b90dc4-caf9-4b96-a6d6-11bd59bd26b4 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:55.277244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1194/2386] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:46:58.391370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864a9a1-c6e5-408e-bcbd-d602c9d09eeb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:46:58.400860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864a9a1-c6e5-408e-bcbd-d602c9d09eeb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:46:58.404625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30fd64-6798-4992-b987-b5a7e48483ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:46:58.405267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30fd64-6798-4992-b987-b5a7e48483ac service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:46:58.405548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30fd64-6798-4992-b987-b5a7e48483ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:46:58.405820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30fd64-6798-4992-b987-b5a7e48483ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:46:58.407666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5b30fd64-6798-4992-b987-b5a7e48483ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:46:58.420915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30fd64-6798-4992-b987-b5a7e48483ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:46:58.422383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30fd64-6798-4992-b987-b5a7e48483ac service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:46:58.433455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1193/2387] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:46:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:47:01.913487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b90dc4-caf9-4b96-a6d6-11bd59bd26b4 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:47:01.914997 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a1b90dc4-caf9-4b96-a6d6-11bd59bd26b4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:47:01.930572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b90dc4-caf9-4b96-a6d6-11bd59bd26b4 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:47:01.935898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f1292-e521-4d39-a054-c11b9ca6759f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:47:01.936531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f1292-e521-4d39-a054-c11b9ca6759f service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:47:01.936814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f1292-e521-4d39-a054-c11b9ca6759f service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:47:01.937090 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f1292-e521-4d39-a054-c11b9ca6759f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:47:01.938840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f0f1292-e521-4d39-a054-c11b9ca6759f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:47:02.014022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f1292-e521-4d39-a054-c11b9ca6759f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:47:02.015710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f1292-e521-4d39-a054-c11b9ca6759f service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:47:02.025649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1195/2388] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:47:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:47:14.066427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30fd64-6798-4992-b987-b5a7e48483ac service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:47:14.074888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30fd64-6798-4992-b987-b5a7e48483ac service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:47:14.078480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694ce34-f259-4d20-958f-de44c31d9414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:47:14.079153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ce34-f259-4d20-958f-de44c31d9414 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:47:14.079431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ce34-f259-4d20-958f-de44c31d9414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:47:14.079703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ce34-f259-4d20-958f-de44c31d9414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:47:14.081437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2694ce34-f259-4d20-958f-de44c31d9414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:47:14.090419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694ce34-f259-4d20-958f-de44c31d9414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:47:14.091825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694ce34-f259-4d20-958f-de44c31d9414 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:47:14.099435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1194/2389] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:47:27.628390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67579160-5bf8-492f-adc2-feea93b4a4a4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:47:27.628913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67579160-5bf8-492f-adc2-feea93b4a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:47:27.629011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67579160-5bf8-492f-adc2-feea93b4a4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:47:27.646492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-67579160-5bf8-492f-adc2-feea93b4a4a4 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:47:27.647677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-67579160-5bf8-492f-adc2-feea93b4a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:47:27.654725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1196/2390] 10.222.0.75 () {58 vars in 967 bytes} [Tue May 17 15:47:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:47:27.667604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694ce34-f259-4d20-958f-de44c31d9414 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:47:27.679187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694ce34-f259-4d20-958f-de44c31d9414 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:47:27.684116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3604a6-100b-4d21-ae94-478f9858bf7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:47:27.684758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3604a6-100b-4d21-ae94-478f9858bf7e service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:47:27.685037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3604a6-100b-4d21-ae94-478f9858bf7e service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:47:27.685309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3604a6-100b-4d21-ae94-478f9858bf7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:47:27.693084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3604a6-100b-4d21-ae94-478f9858bf7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:47:27.694701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3604a6-100b-4d21-ae94-478f9858bf7e service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:47:27.702433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1195/2391] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:47:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:47:34.907736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67579160-5bf8-492f-adc2-feea93b4a4a4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:47:34.909225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-67579160-5bf8-492f-adc2-feea93b4a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:47:34.925112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67579160-5bf8-492f-adc2-feea93b4a4a4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:47:34.930578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0aa8e-b0ed-450a-bf33-5d033b8e9d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:47:34.931204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0aa8e-b0ed-450a-bf33-5d033b8e9d85 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:47:34.931493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0aa8e-b0ed-450a-bf33-5d033b8e9d85 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:47:34.931770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0aa8e-b0ed-450a-bf33-5d033b8e9d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:47:34.933462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5ab0aa8e-b0ed-450a-bf33-5d033b8e9d85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:47:34.988734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0aa8e-b0ed-450a-bf33-5d033b8e9d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:47:34.990326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0aa8e-b0ed-450a-bf33-5d033b8e9d85 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:47:34.998987 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1197/2392] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:47:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:48:04.335241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad046-d607-4d65-8ab0-89615a35e670 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:48:04.335834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad046-d607-4d65-8ab0-89615a35e670 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:48:04.335834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad046-d607-4d65-8ab0-89615a35e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:48:04.352840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-790ad046-d607-4d65-8ab0-89615a35e670 None None] MFA Rules not processed for user `b40c7b11fff443fa8c78e8647703e230`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:48:04.354036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-790ad046-d607-4d65-8ab0-89615a35e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:04.360729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1196/2393] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:48:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:48:10.426545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0aa8e-b0ed-450a-bf33-5d033b8e9d85 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:48:10.439142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0aa8e-b0ed-450a-bf33-5d033b8e9d85 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:48:10.445304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9a8c6-132f-4d1b-935d-0af93eb8696c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:48:10.445955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9a8c6-132f-4d1b-935d-0af93eb8696c service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:48:10.446270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9a8c6-132f-4d1b-935d-0af93eb8696c service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:48:10.446553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9a8c6-132f-4d1b-935d-0af93eb8696c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:48:10.448335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cbb9a8c6-132f-4d1b-935d-0af93eb8696c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:10.460605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9a8c6-132f-4d1b-935d-0af93eb8696c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:48:10.462428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9a8c6-132f-4d1b-935d-0af93eb8696c service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:48:10.474703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1198/2394] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:48:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:48:32.947775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ad046-d607-4d65-8ab0-89615a35e670 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:48:32.960565 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ad046-d607-4d65-8ab0-89615a35e670 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:48:32.965926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def20dd-974e-4720-8c9b-f39b3b6eeae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:48:32.966590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def20dd-974e-4720-8c9b-f39b3b6eeae5 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:48:32.966874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def20dd-974e-4720-8c9b-f39b3b6eeae5 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:48:32.967154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def20dd-974e-4720-8c9b-f39b3b6eeae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:48:32.968933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2def20dd-974e-4720-8c9b-f39b3b6eeae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:32.979841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def20dd-974e-4720-8c9b-f39b3b6eeae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:48:32.981413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def20dd-974e-4720-8c9b-f39b3b6eeae5 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:48:32.990926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1197/2395] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:48:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:48:44.687655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a6eb7-c450-4c71-b349-b79378bfe622 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:48:44.688148 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a6eb7-c450-4c71-b349-b79378bfe622 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:48:44.688259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a6eb7-c450-4c71-b349-b79378bfe622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:48:44.706030 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-594a6eb7-c450-4c71-b349-b79378bfe622 None None] MFA Rules not processed for user `d099a8ecc77b4259aa30f227ae8f28ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:48:44.707335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-594a6eb7-c450-4c71-b349-b79378bfe622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:44.714821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1199/2396] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:48:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:48:45.009363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def20dd-974e-4720-8c9b-f39b3b6eeae5 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:48:45.019056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def20dd-974e-4720-8c9b-f39b3b6eeae5 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:48:45.022676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b3ba5-84ab-428a-9727-db1e6cc85861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:48:45.023302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b3ba5-84ab-428a-9727-db1e6cc85861 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:48:45.023590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b3ba5-84ab-428a-9727-db1e6cc85861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:48:45.023865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b3ba5-84ab-428a-9727-db1e6cc85861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:48:45.025739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e61b3ba5-84ab-428a-9727-db1e6cc85861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:45.034952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b3ba5-84ab-428a-9727-db1e6cc85861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:48:45.036372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b3ba5-84ab-428a-9727-db1e6cc85861 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:48:45.044104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1198/2397] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:48:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:48:45.356019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a6eb7-c450-4c71-b349-b79378bfe622 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:48:45.357487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-594a6eb7-c450-4c71-b349-b79378bfe622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:45.429437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a6eb7-c450-4c71-b349-b79378bfe622 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:48:45.434269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48342a3-8cec-4d2f-84bc-c855cf373fea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:48:45.434902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48342a3-8cec-4d2f-84bc-c855cf373fea service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:48:45.435180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48342a3-8cec-4d2f-84bc-c855cf373fea service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:48:45.435454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48342a3-8cec-4d2f-84bc-c855cf373fea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:48:45.437176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a48342a3-8cec-4d2f-84bc-c855cf373fea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:45.448860 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48342a3-8cec-4d2f-84bc-c855cf373fea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:48:45.450448 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48342a3-8cec-4d2f-84bc-c855cf373fea service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:48:45.459917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1200/2398] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:48:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:48:55.859642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b3ba5-84ab-428a-9727-db1e6cc85861 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:48:55.882312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b3ba5-84ab-428a-9727-db1e6cc85861 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:48:55.888900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18ade-f45d-4932-b2ca-c9efa4f15795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:48:55.889544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18ade-f45d-4932-b2ca-c9efa4f15795 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:48:55.889826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18ade-f45d-4932-b2ca-c9efa4f15795 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:48:55.890136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18ade-f45d-4932-b2ca-c9efa4f15795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:48:55.891934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cce18ade-f45d-4932-b2ca-c9efa4f15795 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:55.905717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18ade-f45d-4932-b2ca-c9efa4f15795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:48:55.907354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18ade-f45d-4932-b2ca-c9efa4f15795 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:48:55.930223 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1199/2399] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:48:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:48:56.962908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aca9c-7527-440b-a579-1d95152d2243 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:48:56.963428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aca9c-7527-440b-a579-1d95152d2243 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:48:56.963522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aca9c-7527-440b-a579-1d95152d2243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:48:56.981177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4e7aca9c-7527-440b-a579-1d95152d2243 None None] MFA Rules not processed for user `2e4972b781b043f69740342fde4efa73`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:48:56.982386 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4e7aca9c-7527-440b-a579-1d95152d2243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:56.989584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1201/2400] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:48:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:48:59.911171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18ade-f45d-4932-b2ca-c9efa4f15795 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:48:59.922369 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18ade-f45d-4932-b2ca-c9efa4f15795 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:48:59.929304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43488e19-e1d6-4dd3-9cc3-49f55c444cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:48:59.929981 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43488e19-e1d6-4dd3-9cc3-49f55c444cf2 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:48:59.930294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43488e19-e1d6-4dd3-9cc3-49f55c444cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:48:59.930614 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43488e19-e1d6-4dd3-9cc3-49f55c444cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:48:59.932750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-43488e19-e1d6-4dd3-9cc3-49f55c444cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:48:59.945897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43488e19-e1d6-4dd3-9cc3-49f55c444cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:48:59.947553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43488e19-e1d6-4dd3-9cc3-49f55c444cf2 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:48:59.959879 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1200/2401] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:48:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:49:25.055541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44fc22-5ded-4872-a92a-4cbfbd6e6cf0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:25.056131 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44fc22-5ded-4872-a92a-4cbfbd6e6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:25.056232 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44fc22-5ded-4872-a92a-4cbfbd6e6cf0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:25.057729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1202/2402] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:49:25.064088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cfff3-691d-42ef-ae23-7e12f1b904ab None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:25.064561 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cfff3-691d-42ef-ae23-7e12f1b904ab None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:25.064656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cfff3-691d-42ef-ae23-7e12f1b904ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:25.083182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-636cfff3-691d-42ef-ae23-7e12f1b904ab None None] MFA Rules not processed for user `03e9f522282644e2aad2eefba7509f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:25.084407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-636cfff3-691d-42ef-ae23-7e12f1b904ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:25.090839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1201/2403] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:49:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:49:25.104667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44fc22-5ded-4872-a92a-4cbfbd6e6cf0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:25.106717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a44fc22-5ded-4872-a92a-4cbfbd6e6cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:25.120216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44fc22-5ded-4872-a92a-4cbfbd6e6cf0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:25.123837 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f777abd-a3dc-4c41-afee-76689f707f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:25.124470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f777abd-a3dc-4c41-afee-76689f707f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:25.124780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f777abd-a3dc-4c41-afee-76689f707f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:25.125048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f777abd-a3dc-4c41-afee-76689f707f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:25.132652 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f777abd-a3dc-4c41-afee-76689f707f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:25.134278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f777abd-a3dc-4c41-afee-76689f707f4b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:25.144923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1203/2404] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:49:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:49:25.223648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd00c-11d0-41fc-9e7e-0c0985e3fe55 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:25.223971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd00c-11d0-41fc-9e7e-0c0985e3fe55 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:25.224250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd00c-11d0-41fc-9e7e-0c0985e3fe55 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:25.225620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1202/2405] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:49:25.232155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb7a5c-44dc-4666-a307-d1cb835959d4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:25.232444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb7a5c-44dc-4666-a307-d1cb835959d4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:25.232718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb7a5c-44dc-4666-a307-d1cb835959d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:25.258870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5deb7a5c-44dc-4666-a307-d1cb835959d4 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:25.260054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5deb7a5c-44dc-4666-a307-d1cb835959d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:25.271180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1204/2406] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:49:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:49:25.282143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebd00c-11d0-41fc-9e7e-0c0985e3fe55 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:25.293400 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebd00c-11d0-41fc-9e7e-0c0985e3fe55 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:25.296901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdc243-ea84-4947-98d9-4e69631d5080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:25.297552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdc243-ea84-4947-98d9-4e69631d5080 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:25.297829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdc243-ea84-4947-98d9-4e69631d5080 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:25.298206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdc243-ea84-4947-98d9-4e69631d5080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:25.308606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdc243-ea84-4947-98d9-4e69631d5080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:25.310042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdc243-ea84-4947-98d9-4e69631d5080 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:25.320272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1203/2407] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:49:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:49:37.337476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb7a5c-44dc-4666-a307-d1cb835959d4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:37.349926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb7a5c-44dc-4666-a307-d1cb835959d4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:37.353895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0a94b-a3a6-4b74-815f-8a76fb187893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:37.354584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0a94b-a3a6-4b74-815f-8a76fb187893 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:37.354869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0a94b-a3a6-4b74-815f-8a76fb187893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:37.355144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0a94b-a3a6-4b74-815f-8a76fb187893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:37.356953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dbf0a94b-a3a6-4b74-815f-8a76fb187893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:37.421502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0a94b-a3a6-4b74-815f-8a76fb187893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:37.422894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0a94b-a3a6-4b74-815f-8a76fb187893 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:37.433230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1205/2408] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:49:40.604368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdc243-ea84-4947-98d9-4e69631d5080 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:40.606309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-15cdc243-ea84-4947-98d9-4e69631d5080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:40.624117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdc243-ea84-4947-98d9-4e69631d5080 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:40.629332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:40.630494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:40.630777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:40.631053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] PATH_INFO: `/v3/users/b40c7b11fff443fa8c78e8647703e230` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:40.632252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40c7b11fff443fa8c78e8647703e230)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:40.634286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:40.681283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40c7b11fff443fa8c78e8647703e230'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:40.694153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40c7b11fff443fa8c78e8647703e230'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:40.694896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40c7b11fff443fa8c78e8647703e230'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:40.695508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40c7b11fff443fa8c78e8647703e230'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:40.704768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-695a86c4-1b3b-42ea-8121-f9296e93a246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40c7b11fff443fa8c78e8647703e230'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:40.716852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1204/2409] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:49:40 2022] DELETE /identity/v3/users/b40c7b11fff443fa8c78e8647703e230 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:49:40.908905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0a94b-a3a6-4b74-815f-8a76fb187893 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:40.917536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0a94b-a3a6-4b74-815f-8a76fb187893 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:40.974049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:40.974902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:40.975176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:40.975444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] PATH_INFO: `/v3/projects/87cc0cd3d0df4dccbc28058b6866d076` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:40.976604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cc0cd3d0df4dccbc28058b6866d076)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:40.978768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:41.022069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cc0cd3d0df4dccbc28058b6866d076', 'request_id': 'req-eb59df18-50a3-4803-923f-d32e9231271f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:41.027877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cc0cd3d0df4dccbc28058b6866d076', 'request_id': 'req-eb59df18-50a3-4803-923f-d32e9231271f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:41.034635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cc0cd3d0df4dccbc28058b6866d076', 'request_id': 'req-eb59df18-50a3-4803-923f-d32e9231271f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:41.044051 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] The token cache is being invalidate because project 87cc0cd3d0df4dccbc28058b6866d076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:49:41.044339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:41.044936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eb59df18-50a3-4803-923f-d32e9231271f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:41.046470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1206/2410] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:49:40 2022] DELETE /identity/v3/projects/87cc0cd3d0df4dccbc28058b6866d076 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:49:41.051420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e02e8-8fc1-48d6-ad91-dbb8d0769ba4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.051743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e02e8-8fc1-48d6-ad91-dbb8d0769ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.052022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e02e8-8fc1-48d6-ad91-dbb8d0769ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.070071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-706e02e8-8fc1-48d6-ad91-dbb8d0769ba4 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:41.071271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-706e02e8-8fc1-48d6-ad91-dbb8d0769ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:41.131454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1205/2411] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:49:41.141432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527e254-62c5-4af0-8c4a-a15711f2d0fd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.141720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527e254-62c5-4af0-8c4a-a15711f2d0fd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.141991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527e254-62c5-4af0-8c4a-a15711f2d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.164133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d527e254-62c5-4af0-8c4a-a15711f2d0fd None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:41.165324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d527e254-62c5-4af0-8c4a-a15711f2d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:41.175548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1207/2412] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:49:41.180427 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e02e8-8fc1-48d6-ad91-dbb8d0769ba4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:41.191345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e02e8-8fc1-48d6-ad91-dbb8d0769ba4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:41.195848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289514e6-3f6e-4d64-b607-6e1940c3a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:41.196486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289514e6-3f6e-4d64-b607-6e1940c3a926 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.196767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289514e6-3f6e-4d64-b607-6e1940c3a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.197036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289514e6-3f6e-4d64-b607-6e1940c3a926 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.197751 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289514e6-3f6e-4d64-b607-6e1940c3a926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:49:41.198086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289514e6-3f6e-4d64-b607-6e1940c3a926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:41.199677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289514e6-3f6e-4d64-b607-6e1940c3a926 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:41.211688 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1206/2413] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:49:41.216045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527e254-62c5-4af0-8c4a-a15711f2d0fd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:41.224960 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527e254-62c5-4af0-8c4a-a15711f2d0fd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:41.229855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338116d-2422-4efd-98b6-aadc8c70cf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:41.230523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338116d-2422-4efd-98b6-aadc8c70cf7e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.230807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338116d-2422-4efd-98b6-aadc8c70cf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.231078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338116d-2422-4efd-98b6-aadc8c70cf7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.231763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338116d-2422-4efd-98b6-aadc8c70cf7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:41.233660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338116d-2422-4efd-98b6-aadc8c70cf7e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:41.267495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1208/2414] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:49:41 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:49:41.272206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289514e6-3f6e-4d64-b607-6e1940c3a926 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:41.282163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289514e6-3f6e-4d64-b607-6e1940c3a926 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:41.335527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43815b27-4d9a-4806-a2a6-9e0924ed48d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:41.336185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815b27-4d9a-4806-a2a6-9e0924ed48d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.336469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815b27-4d9a-4806-a2a6-9e0924ed48d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.336742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815b27-4d9a-4806-a2a6-9e0924ed48d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.337409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43815b27-4d9a-4806-a2a6-9e0924ed48d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:41.339353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43815b27-4d9a-4806-a2a6-9e0924ed48d6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:41.358087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1207/2415] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:49:41 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:49:41.362694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338116d-2422-4efd-98b6-aadc8c70cf7e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:41.373498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338116d-2422-4efd-98b6-aadc8c70cf7e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:41.378668 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eea39-5ad1-4787-a978-1e1f1fca2d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:41.379311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eea39-5ad1-4787-a978-1e1f1fca2d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.379589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eea39-5ad1-4787-a978-1e1f1fca2d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.379860 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eea39-5ad1-4787-a978-1e1f1fca2d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.380579 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eea39-5ad1-4787-a978-1e1f1fca2d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:41.382189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eea39-5ad1-4787-a978-1e1f1fca2d72 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:41.391680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1209/2416] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:49:41.395461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43815b27-4d9a-4806-a2a6-9e0924ed48d6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:41.405097 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43815b27-4d9a-4806-a2a6-9e0924ed48d6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:41.409829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3b89f-a452-4dda-b687-ee30a40ca6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:41.410505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b89f-a452-4dda-b687-ee30a40ca6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.410786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b89f-a452-4dda-b687-ee30a40ca6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.411059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b89f-a452-4dda-b687-ee30a40ca6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.411799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3b89f-a452-4dda-b687-ee30a40ca6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:41.413373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3b89f-a452-4dda-b687-ee30a40ca6c8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:41.422825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1208/2417] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:49:41.427321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eea39-5ad1-4787-a978-1e1f1fca2d72 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:41.437095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eea39-5ad1-4787-a978-1e1f1fca2d72 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:41.442381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb051765-0ec5-4230-b3ee-2b21cc0e7efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:41.443240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb051765-0ec5-4230-b3ee-2b21cc0e7efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.443524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb051765-0ec5-4230-b3ee-2b21cc0e7efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.443797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb051765-0ec5-4230-b3ee-2b21cc0e7efe admin admin] PATH_INFO: `/v3/projects/9d60e9e497094744b410f33cbfce2b66/users/5897859fb64c426e804259d2449e96f5/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.458957 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb051765-0ec5-4230-b3ee-2b21cc0e7efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d60e9e497094744b410f33cbfce2b66, user_id=5897859fb64c426e804259d2449e96f5, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:41.461659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb051765-0ec5-4230-b3ee-2b21cc0e7efe admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:41.477495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1210/2418] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:49:41 2022] PUT /identity/v3/projects/9d60e9e497094744b410f33cbfce2b66/users/5897859fb64c426e804259d2449e96f5/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:49:41.490185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb7e5-658d-42bb-b507-c181218b4294 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.490701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb7e5-658d-42bb-b507-c181218b4294 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.491268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb7e5-658d-42bb-b507-c181218b4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.520341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-73bdb7e5-658d-42bb-b507-c181218b4294 None None] MFA Rules not processed for user `5897859fb64c426e804259d2449e96f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:41.521580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-73bdb7e5-658d-42bb-b507-c181218b4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:41.582624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1209/2419] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:49:41.593516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb051765-0ec5-4230-b3ee-2b21cc0e7efe admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:41.595260 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bb051765-0ec5-4230-b3ee-2b21cc0e7efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:41.666718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb051765-0ec5-4230-b3ee-2b21cc0e7efe admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:41.672228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3f92a-7f3b-4b9e-888b-9fe7ba350235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:41.672888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f92a-7f3b-4b9e-888b-9fe7ba350235 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:41.673150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f92a-7f3b-4b9e-888b-9fe7ba350235 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:41.673425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f92a-7f3b-4b9e-888b-9fe7ba350235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:41.681473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3f92a-7f3b-4b9e-888b-9fe7ba350235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:41.683004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3f92a-7f3b-4b9e-888b-9fe7ba350235 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:41.692112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1211/2420] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:49:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:49:50.975657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdb7e5-658d-42bb-b507-c181218b4294 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:51.036488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdb7e5-658d-42bb-b507-c181218b4294 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:51.041153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:51.042028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.042318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.042597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] PATH_INFO: `/v3/users/5897859fb64c426e804259d2449e96f5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.043785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5897859fb64c426e804259d2449e96f5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:51.045707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:51.090091 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5897859fb64c426e804259d2449e96f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.102623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5897859fb64c426e804259d2449e96f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.103275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5897859fb64c426e804259d2449e96f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.103874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5897859fb64c426e804259d2449e96f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.110408 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5897859fb64c426e804259d2449e96f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.122276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1210/2421] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:49:50 2022] DELETE /identity/v3/users/5897859fb64c426e804259d2449e96f5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:49:51.126923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a105a-b080-4e7d-a046-38ea50a2b96a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.127433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a105a-b080-4e7d-a046-38ea50a2b96a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.127543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a105a-b080-4e7d-a046-38ea50a2b96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.144294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-313a105a-b080-4e7d-a046-38ea50a2b96a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:51.145505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-313a105a-b080-4e7d-a046-38ea50a2b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:51.200585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1212/2422] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:49:51.210634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:51.212033 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:51.266453 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eeb19-fbca-4416-b51d-2e8f8942211d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:51.270609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6e73f-c120-42bd-a626-eb7620146c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:51.271251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6e73f-c120-42bd-a626-eb7620146c95 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.271533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6e73f-c120-42bd-a626-eb7620146c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.271812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6e73f-c120-42bd-a626-eb7620146c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.280672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6e73f-c120-42bd-a626-eb7620146c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:51.282172 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6e73f-c120-42bd-a626-eb7620146c95 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:51.292547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1211/2423] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:49:51.543433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a105a-b080-4e7d-a046-38ea50a2b96a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:51.544842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-313a105a-b080-4e7d-a046-38ea50a2b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:51.556901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a105a-b080-4e7d-a046-38ea50a2b96a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:51.561489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:51.562387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.562670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.562947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] PATH_INFO: `/v3/projects/9d60e9e497094744b410f33cbfce2b66` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.564137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d60e9e497094744b410f33cbfce2b66)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:51.566046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:51.613862 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d60e9e497094744b410f33cbfce2b66', 'request_id': 'req-52a7ccbb-00a0-47cc-899e-508431c2c9af'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.619859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d60e9e497094744b410f33cbfce2b66', 'request_id': 'req-52a7ccbb-00a0-47cc-899e-508431c2c9af'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.626312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d60e9e497094744b410f33cbfce2b66', 'request_id': 'req-52a7ccbb-00a0-47cc-899e-508431c2c9af'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.636158 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] The token cache is being invalidate because project 9d60e9e497094744b410f33cbfce2b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:49:51.636445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.637060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-52a7ccbb-00a0-47cc-899e-508431c2c9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:49:51.638620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1213/2424] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:49:51 2022] DELETE /identity/v3/projects/9d60e9e497094744b410f33cbfce2b66 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:49:51.643538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972cba2-2f12-467d-8b43-a52657875e0e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.643827 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972cba2-2f12-467d-8b43-a52657875e0e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.644105 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972cba2-2f12-467d-8b43-a52657875e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.661779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e972cba2-2f12-467d-8b43-a52657875e0e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:51.663018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e972cba2-2f12-467d-8b43-a52657875e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:51.721693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1212/2425] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:49:51.729619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c90b1-6a5d-4f3f-a082-defb502e934f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.729912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c90b1-6a5d-4f3f-a082-defb502e934f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.730302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c90b1-6a5d-4f3f-a082-defb502e934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.749382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-104c90b1-6a5d-4f3f-a082-defb502e934f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:51.750620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-104c90b1-6a5d-4f3f-a082-defb502e934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:51.758574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1214/2426] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:49:51.762714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972cba2-2f12-467d-8b43-a52657875e0e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:51.772148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972cba2-2f12-467d-8b43-a52657875e0e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:51.776722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd3d30-0def-45fd-800f-0667961af368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:51.777372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd3d30-0def-45fd-800f-0667961af368 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.777662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd3d30-0def-45fd-800f-0667961af368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.777929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd3d30-0def-45fd-800f-0667961af368 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.778686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd3d30-0def-45fd-800f-0667961af368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:49:51.778993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd3d30-0def-45fd-800f-0667961af368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:51.780581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd3d30-0def-45fd-800f-0667961af368 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:51.792548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1213/2427] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:49:51.796805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c90b1-6a5d-4f3f-a082-defb502e934f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:51.806431 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c90b1-6a5d-4f3f-a082-defb502e934f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:51.811096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a66c0-7116-4734-9c40-cdb0ea5ee592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:51.811741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a66c0-7116-4734-9c40-cdb0ea5ee592 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.812026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a66c0-7116-4734-9c40-cdb0ea5ee592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.812304 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a66c0-7116-4734-9c40-cdb0ea5ee592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.813034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a66c0-7116-4734-9c40-cdb0ea5ee592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:51.815007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a66c0-7116-4734-9c40-cdb0ea5ee592 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:51.839610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1215/2428] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:49:51 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:49:51.843552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd3d30-0def-45fd-800f-0667961af368 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:51.854242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd3d30-0def-45fd-800f-0667961af368 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:51.907196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93630ff-0e59-4220-9fb5-9528bb5a87b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:51.907859 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93630ff-0e59-4220-9fb5-9528bb5a87b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.908208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93630ff-0e59-4220-9fb5-9528bb5a87b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.909063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93630ff-0e59-4220-9fb5-9528bb5a87b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.909734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93630ff-0e59-4220-9fb5-9528bb5a87b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:51.911671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93630ff-0e59-4220-9fb5-9528bb5a87b9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:51.930162 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1214/2429] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:49:51 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:49:51.934293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a66c0-7116-4734-9c40-cdb0ea5ee592 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:51.944214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a66c0-7116-4734-9c40-cdb0ea5ee592 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:51.948754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f61e3a-bcec-471b-a8b1-cc34ed1639e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:51.949393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f61e3a-bcec-471b-a8b1-cc34ed1639e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.949674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f61e3a-bcec-471b-a8b1-cc34ed1639e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.949947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f61e3a-bcec-471b-a8b1-cc34ed1639e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.950702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f61e3a-bcec-471b-a8b1-cc34ed1639e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:51.952281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f61e3a-bcec-471b-a8b1-cc34ed1639e8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:51.962669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1216/2430] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:49:51.966277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93630ff-0e59-4220-9fb5-9528bb5a87b9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:51.976474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93630ff-0e59-4220-9fb5-9528bb5a87b9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:51.981546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e920e25-a848-4940-b792-8f3283c7db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:51.982228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e920e25-a848-4940-b792-8f3283c7db5e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:51.982510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e920e25-a848-4940-b792-8f3283c7db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:51.982783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e920e25-a848-4940-b792-8f3283c7db5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:51.983517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e920e25-a848-4940-b792-8f3283c7db5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:51.985127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e920e25-a848-4940-b792-8f3283c7db5e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:51.995301 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1215/2431] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:49:51.999109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f61e3a-bcec-471b-a8b1-cc34ed1639e8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:52.008693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f61e3a-bcec-471b-a8b1-cc34ed1639e8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:52.013212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2ad1a-9125-4382-a38f-2fa223625826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:52.014104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2ad1a-9125-4382-a38f-2fa223625826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.014387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2ad1a-9125-4382-a38f-2fa223625826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.014662 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2ad1a-9125-4382-a38f-2fa223625826 admin admin] PATH_INFO: `/v3/projects/3c71f39f93dd49a483d1f7497648563e/users/0c475d8d4fd140e1a44ff8ba010a6ff5/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.028795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2ad1a-9125-4382-a38f-2fa223625826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c71f39f93dd49a483d1f7497648563e, user_id=0c475d8d4fd140e1a44ff8ba010a6ff5, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:52.031468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2ad1a-9125-4382-a38f-2fa223625826 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:52.043827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1217/2432] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:49:51 2022] PUT /identity/v3/projects/3c71f39f93dd49a483d1f7497648563e/users/0c475d8d4fd140e1a44ff8ba010a6ff5/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:49:52.054515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8a27e-43fe-4922-bb06-8c1a9a972c10 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.054758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8a27e-43fe-4922-bb06-8c1a9a972c10 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.055033 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8a27e-43fe-4922-bb06-8c1a9a972c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.081160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-14a8a27e-43fe-4922-bb06-8c1a9a972c10 None None] MFA Rules not processed for user `0c475d8d4fd140e1a44ff8ba010a6ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:52.082477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-14a8a27e-43fe-4922-bb06-8c1a9a972c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:52.144480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1216/2433] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:49:52.149052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2ad1a-9125-4382-a38f-2fa223625826 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:52.208634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2ad1a-9125-4382-a38f-2fa223625826 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:52.213169 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f35c46-5c80-4b0d-9597-a7f959b8a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:52.213801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f35c46-5c80-4b0d-9597-a7f959b8a935 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.214107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f35c46-5c80-4b0d-9597-a7f959b8a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.214380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f35c46-5c80-4b0d-9597-a7f959b8a935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.215052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f35c46-5c80-4b0d-9597-a7f959b8a935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:52.216923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f35c46-5c80-4b0d-9597-a7f959b8a935 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:52.242199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1218/2434] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:49:52 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:49:52.246233 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8a27e-43fe-4922-bb06-8c1a9a972c10 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:52.257240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8a27e-43fe-4922-bb06-8c1a9a972c10 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:52.311653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c9019-9964-41aa-b8dd-2a146f60218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:52.312244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c9019-9964-41aa-b8dd-2a146f60218c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.312525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c9019-9964-41aa-b8dd-2a146f60218c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.312801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c9019-9964-41aa-b8dd-2a146f60218c admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.313494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c9019-9964-41aa-b8dd-2a146f60218c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:52.315936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c9019-9964-41aa-b8dd-2a146f60218c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:52.335999 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1217/2435] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:49:52 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:49:52.339968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f35c46-5c80-4b0d-9597-a7f959b8a935 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:52.349929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f35c46-5c80-4b0d-9597-a7f959b8a935 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:52.354838 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eccfa-bdfd-460c-9e8e-4f41a17edd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:52.355478 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eccfa-bdfd-460c-9e8e-4f41a17edd1e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.355760 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eccfa-bdfd-460c-9e8e-4f41a17edd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.356035 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eccfa-bdfd-460c-9e8e-4f41a17edd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.356746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eccfa-bdfd-460c-9e8e-4f41a17edd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:52.358358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eccfa-bdfd-460c-9e8e-4f41a17edd1e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:52.368351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1219/2436] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:49:52.372110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c9019-9964-41aa-b8dd-2a146f60218c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:52.382239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c9019-9964-41aa-b8dd-2a146f60218c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:52.386823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a15f9-dada-4159-b8ec-b62c16ed191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:52.387682 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a15f9-dada-4159-b8ec-b62c16ed191d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.387964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a15f9-dada-4159-b8ec-b62c16ed191d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.388238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a15f9-dada-4159-b8ec-b62c16ed191d admin admin] PATH_INFO: `/v3/projects/d93ad8cbd2ed4047b20d17998c6c82b5/users/0ec54a028a73456396ce0a02fe86b195/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.402914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a15f9-dada-4159-b8ec-b62c16ed191d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93ad8cbd2ed4047b20d17998c6c82b5, user_id=0ec54a028a73456396ce0a02fe86b195, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:52.405567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a15f9-dada-4159-b8ec-b62c16ed191d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:52.418318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1218/2437] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:49:52 2022] PUT /identity/v3/projects/d93ad8cbd2ed4047b20d17998c6c82b5/users/0ec54a028a73456396ce0a02fe86b195/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:49:52.422271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eccfa-bdfd-460c-9e8e-4f41a17edd1e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:52.431937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eccfa-bdfd-460c-9e8e-4f41a17edd1e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:52.485743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf42d5b-6d0a-4343-9f76-158a27520523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:52.486417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf42d5b-6d0a-4343-9f76-158a27520523 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.486697 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf42d5b-6d0a-4343-9f76-158a27520523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.486967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf42d5b-6d0a-4343-9f76-158a27520523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.487665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf42d5b-6d0a-4343-9f76-158a27520523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:52.489248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf42d5b-6d0a-4343-9f76-158a27520523 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:52.498511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1220/2438] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:49:52.503069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a15f9-dada-4159-b8ec-b62c16ed191d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:52.512993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a15f9-dada-4159-b8ec-b62c16ed191d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:52.518252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c399a0-b070-4d73-a9ec-fea74591b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:52.519115 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c399a0-b070-4d73-a9ec-fea74591b031 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.519396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c399a0-b070-4d73-a9ec-fea74591b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.519690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c399a0-b070-4d73-a9ec-fea74591b031 admin admin] PATH_INFO: `/v3/projects/d93ad8cbd2ed4047b20d17998c6c82b5/users/0ec54a028a73456396ce0a02fe86b195/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.521640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c399a0-b070-4d73-a9ec-fea74591b031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93ad8cbd2ed4047b20d17998c6c82b5, user_id=0ec54a028a73456396ce0a02fe86b195, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:52.524319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c399a0-b070-4d73-a9ec-fea74591b031 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:52.534058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1219/2439] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:49:52 2022] PUT /identity/v3/projects/d93ad8cbd2ed4047b20d17998c6c82b5/users/0ec54a028a73456396ce0a02fe86b195/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:49:52.544921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdd7eb-7248-4b27-8ae9-23c240ab564a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.545206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdd7eb-7248-4b27-8ae9-23c240ab564a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.545476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdd7eb-7248-4b27-8ae9-23c240ab564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.570850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7efdd7eb-7248-4b27-8ae9-23c240ab564a None None] MFA Rules not processed for user `0ec54a028a73456396ce0a02fe86b195`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:49:52.571963 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7efdd7eb-7248-4b27-8ae9-23c240ab564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:52.636384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1221/2440] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:49:52.647340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c399a0-b070-4d73-a9ec-fea74591b031 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:52.649283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-68c399a0-b070-4d73-a9ec-fea74591b031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:49:52.708930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c399a0-b070-4d73-a9ec-fea74591b031 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:52.712942 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb466e6-8267-40b1-8c33-1309a83399cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:52.713649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb466e6-8267-40b1-8c33-1309a83399cc service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.713969 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb466e6-8267-40b1-8c33-1309a83399cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.714310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb466e6-8267-40b1-8c33-1309a83399cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.723883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb466e6-8267-40b1-8c33-1309a83399cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:52.725426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb466e6-8267-40b1-8c33-1309a83399cc service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:52.735714 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1220/2441] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:49:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:49:52.806762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdd7eb-7248-4b27-8ae9-23c240ab564a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:49:52.816880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdd7eb-7248-4b27-8ae9-23c240ab564a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:49:52.820648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc0abe-418d-4729-a5e2-41ac95d5142f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:49:52.821336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0abe-418d-4729-a5e2-41ac95d5142f service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:49:52.821563 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0abe-418d-4729-a5e2-41ac95d5142f service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:49:52.821835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0abe-418d-4729-a5e2-41ac95d5142f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:49:52.875594 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc0abe-418d-4729-a5e2-41ac95d5142f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:49:52.877614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc0abe-418d-4729-a5e2-41ac95d5142f service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:49:52.886793 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1222/2442] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:49:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:02.593986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb466e6-8267-40b1-8c33-1309a83399cc service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:02.652981 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb466e6-8267-40b1-8c33-1309a83399cc service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:02.657489 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:02.658372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:02.658651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:02.658927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] PATH_INFO: `/v3/users/0c475d8d4fd140e1a44ff8ba010a6ff5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:02.660102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c475d8d4fd140e1a44ff8ba010a6ff5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:02.662018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:02.705112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c475d8d4fd140e1a44ff8ba010a6ff5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:02.716688 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c475d8d4fd140e1a44ff8ba010a6ff5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:02.717350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c475d8d4fd140e1a44ff8ba010a6ff5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:02.717956 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c475d8d4fd140e1a44ff8ba010a6ff5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:02.725250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c475d8d4fd140e1a44ff8ba010a6ff5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:02.738115 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1221/2443] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:50:02 2022] DELETE /identity/v3/users/0c475d8d4fd140e1a44ff8ba010a6ff5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:02.742575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cced59-9493-47ae-8822-e2a1e23bd832 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:02.743120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cced59-9493-47ae-8822-e2a1e23bd832 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:02.743301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cced59-9493-47ae-8822-e2a1e23bd832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:02.760475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f1cced59-9493-47ae-8822-e2a1e23bd832 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:02.761706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f1cced59-9493-47ae-8822-e2a1e23bd832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:02.817927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1223/2444] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:50:02.827667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:02.829031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:02.884581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8311b1-be39-47e2-8786-d06674263eee admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:02.888213 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce64835-3e0a-4983-9d93-557c92ce251f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:02.888843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce64835-3e0a-4983-9d93-557c92ce251f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:02.889123 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce64835-3e0a-4983-9d93-557c92ce251f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:02.889397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce64835-3e0a-4983-9d93-557c92ce251f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:02.898163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce64835-3e0a-4983-9d93-557c92ce251f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:02.899583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce64835-3e0a-4983-9d93-557c92ce251f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:02.909255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1222/2445] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:03.161391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cced59-9493-47ae-8822-e2a1e23bd832 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:03.162846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f1cced59-9493-47ae-8822-e2a1e23bd832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:03.174808 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cced59-9493-47ae-8822-e2a1e23bd832 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:03.179485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:03.180417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:03.180706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:03.180981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] PATH_INFO: `/v3/projects/3c71f39f93dd49a483d1f7497648563e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:03.182241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c71f39f93dd49a483d1f7497648563e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:03.184152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:03.231015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c71f39f93dd49a483d1f7497648563e', 'request_id': 'req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.237258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c71f39f93dd49a483d1f7497648563e', 'request_id': 'req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.245184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c71f39f93dd49a483d1f7497648563e', 'request_id': 'req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.255236 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] The token cache is being invalidate because project 3c71f39f93dd49a483d1f7497648563e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:50:03.255523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.256143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.257700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1224/2446] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:50:03 2022] DELETE /identity/v3/projects/3c71f39f93dd49a483d1f7497648563e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:03.261651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce64835-3e0a-4983-9d93-557c92ce251f service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:03.271935 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce64835-3e0a-4983-9d93-557c92ce251f service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:03.325718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:03.326532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:03.326816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:03.327093 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] PATH_INFO: `/v3/users/0ec54a028a73456396ce0a02fe86b195` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:03.328264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec54a028a73456396ce0a02fe86b195)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:03.330726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:03.375132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec54a028a73456396ce0a02fe86b195'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.386568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec54a028a73456396ce0a02fe86b195'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.387216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec54a028a73456396ce0a02fe86b195'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.387820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec54a028a73456396ce0a02fe86b195'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.394883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-88bb0d82-5ad4-49d1-881a-cfbdaf36f69e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec54a028a73456396ce0a02fe86b195'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.409088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1223/2447] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:50:03 2022] DELETE /identity/v3/users/0ec54a028a73456396ce0a02fe86b195 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:03.674940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:03.676435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:03.689966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d828e7-3b79-44d1-a102-3d360ae2bc7e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:03.746712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:03.747753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:03.748037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:03.748313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] PATH_INFO: `/v3/projects/d93ad8cbd2ed4047b20d17998c6c82b5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:03.749499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93ad8cbd2ed4047b20d17998c6c82b5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:03.751937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:03.794968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93ad8cbd2ed4047b20d17998c6c82b5', 'request_id': 'req-a0a111d8-0c2c-4514-93f0-85ef36c64997'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.800835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93ad8cbd2ed4047b20d17998c6c82b5', 'request_id': 'req-a0a111d8-0c2c-4514-93f0-85ef36c64997'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.807763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93ad8cbd2ed4047b20d17998c6c82b5', 'request_id': 'req-a0a111d8-0c2c-4514-93f0-85ef36c64997'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.818255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] The token cache is being invalidate because project d93ad8cbd2ed4047b20d17998c6c82b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:50:03.818650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.819271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0a111d8-0c2c-4514-93f0-85ef36c64997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:03.820784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1225/2448] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:50:03 2022] DELETE /identity/v3/projects/d93ad8cbd2ed4047b20d17998c6c82b5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:03.825655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2574e63-596f-454f-8791-0f642a859819 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:03.826228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2574e63-596f-454f-8791-0f642a859819 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:03.826327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2574e63-596f-454f-8791-0f642a859819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:03.843951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c2574e63-596f-454f-8791-0f642a859819 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:03.845150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c2574e63-596f-454f-8791-0f642a859819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:03.903176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1224/2449] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:03.910823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc9423-cfb0-4d2f-905a-5cb6e8649792 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:03.911141 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc9423-cfb0-4d2f-905a-5cb6e8649792 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:03.911414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc9423-cfb0-4d2f-905a-5cb6e8649792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:03.929572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fdbc9423-cfb0-4d2f-905a-5cb6e8649792 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:03.930805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fdbc9423-cfb0-4d2f-905a-5cb6e8649792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:03.938589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1226/2450] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:03.943322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2574e63-596f-454f-8791-0f642a859819 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:03.952739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2574e63-596f-454f-8791-0f642a859819 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:03.957281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be411-eca4-4d07-8b51-648227cf215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:03.957924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be411-eca4-4d07-8b51-648227cf215f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:03.958236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be411-eca4-4d07-8b51-648227cf215f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:03.958513 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be411-eca4-4d07-8b51-648227cf215f admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:03.959229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15be411-eca4-4d07-8b51-648227cf215f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:50:03.959534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15be411-eca4-4d07-8b51-648227cf215f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:03.961122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15be411-eca4-4d07-8b51-648227cf215f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:03.972226 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1225/2451] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:50:03.976498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc9423-cfb0-4d2f-905a-5cb6e8649792 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:03.985729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc9423-cfb0-4d2f-905a-5cb6e8649792 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:03.990876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72320c15-c53b-4edc-843e-1475c9c3ce39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:03.991535 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72320c15-c53b-4edc-843e-1475c9c3ce39 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:03.991819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72320c15-c53b-4edc-843e-1475c9c3ce39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:03.992095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72320c15-c53b-4edc-843e-1475c9c3ce39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:03.992778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72320c15-c53b-4edc-843e-1475c9c3ce39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:03.994693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72320c15-c53b-4edc-843e-1475c9c3ce39 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.019323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1227/2452] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:50:03 2022] POST /identity/v3/projects => generated 401 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:50:04.023431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be411-eca4-4d07-8b51-648227cf215f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.033168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be411-eca4-4d07-8b51-648227cf215f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.086444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92690901-d984-4fc0-bf77-f9c99faeaf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.087095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92690901-d984-4fc0-bf77-f9c99faeaf38 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.087375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92690901-d984-4fc0-bf77-f9c99faeaf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.087647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92690901-d984-4fc0-bf77-f9c99faeaf38 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.088317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92690901-d984-4fc0-bf77-f9c99faeaf38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.090239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92690901-d984-4fc0-bf77-f9c99faeaf38 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.109446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1226/2453] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:50:04 2022] POST /identity/v3/users => generated 301 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:50:04.113972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72320c15-c53b-4edc-843e-1475c9c3ce39 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.123880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72320c15-c53b-4edc-843e-1475c9c3ce39 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.128902 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762ed03-d84f-4b5f-a8f9-e282419fd9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.129546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762ed03-d84f-4b5f-a8f9-e282419fd9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.129829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762ed03-d84f-4b5f-a8f9-e282419fd9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.130130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762ed03-d84f-4b5f-a8f9-e282419fd9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.130851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762ed03-d84f-4b5f-a8f9-e282419fd9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.132428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762ed03-d84f-4b5f-a8f9-e282419fd9ef admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.143187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1228/2454] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:04.147108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92690901-d984-4fc0-bf77-f9c99faeaf38 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.157116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92690901-d984-4fc0-bf77-f9c99faeaf38 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.161925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64326bb3-9142-4d35-b35d-586dc47b9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.163196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64326bb3-9142-4d35-b35d-586dc47b9638 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.163498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64326bb3-9142-4d35-b35d-586dc47b9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.163773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64326bb3-9142-4d35-b35d-586dc47b9638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.164651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64326bb3-9142-4d35-b35d-586dc47b9638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.166419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64326bb3-9142-4d35-b35d-586dc47b9638 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.177799 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1227/2455] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:04.181897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762ed03-d84f-4b5f-a8f9-e282419fd9ef admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.192571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762ed03-d84f-4b5f-a8f9-e282419fd9ef admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.197156 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1a163-3684-4e91-86b8-0e844b29b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.198046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1a163-3684-4e91-86b8-0e844b29b6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.198333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1a163-3684-4e91-86b8-0e844b29b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.198607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1a163-3684-4e91-86b8-0e844b29b6a5 admin admin] PATH_INFO: `/v3/projects/faec257af3ac45b9812739edbfa71ad1/users/2e64bc19c0a144a5a680b9e25a492720/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.214085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1a163-3684-4e91-86b8-0e844b29b6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faec257af3ac45b9812739edbfa71ad1, user_id=2e64bc19c0a144a5a680b9e25a492720, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.216765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1a163-3684-4e91-86b8-0e844b29b6a5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.230487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1229/2456] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:50:04 2022] PUT /identity/v3/projects/faec257af3ac45b9812739edbfa71ad1/users/2e64bc19c0a144a5a680b9e25a492720/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:04.241491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db9651-593c-4721-a3c6-1caf4e625314 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.241792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db9651-593c-4721-a3c6-1caf4e625314 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.242181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db9651-593c-4721-a3c6-1caf4e625314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.269679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-07db9651-593c-4721-a3c6-1caf4e625314 None None] MFA Rules not processed for user `2e64bc19c0a144a5a680b9e25a492720`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:04.271300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-07db9651-593c-4721-a3c6-1caf4e625314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:04.339089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1228/2457] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:04.343527 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1a163-3684-4e91-86b8-0e844b29b6a5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.402270 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1a163-3684-4e91-86b8-0e844b29b6a5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.407215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0faeb2-d440-4a9a-a91a-fbcc15779895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.408332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0faeb2-d440-4a9a-a91a-fbcc15779895 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.408617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0faeb2-d440-4a9a-a91a-fbcc15779895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.408893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0faeb2-d440-4a9a-a91a-fbcc15779895 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.409571 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0faeb2-d440-4a9a-a91a-fbcc15779895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.411491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0faeb2-d440-4a9a-a91a-fbcc15779895 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.436286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1230/2458] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:50:04 2022] POST /identity/v3/projects => generated 401 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:50:04.440542 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db9651-593c-4721-a3c6-1caf4e625314 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.451470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db9651-593c-4721-a3c6-1caf4e625314 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.507662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208dd4c-40f6-4b51-9b3e-d35bf83348f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.508328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208dd4c-40f6-4b51-9b3e-d35bf83348f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.508612 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208dd4c-40f6-4b51-9b3e-d35bf83348f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.508887 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208dd4c-40f6-4b51-9b3e-d35bf83348f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.509557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208dd4c-40f6-4b51-9b3e-d35bf83348f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.511491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208dd4c-40f6-4b51-9b3e-d35bf83348f0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.534168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1229/2459] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:50:04 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:50:04.535314 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0faeb2-d440-4a9a-a91a-fbcc15779895 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.545801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0faeb2-d440-4a9a-a91a-fbcc15779895 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.551075 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f846765-2b57-4830-9ecc-7d3a8a93f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.551725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f846765-2b57-4830-9ecc-7d3a8a93f109 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.552009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f846765-2b57-4830-9ecc-7d3a8a93f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.552286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f846765-2b57-4830-9ecc-7d3a8a93f109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.553013 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f846765-2b57-4830-9ecc-7d3a8a93f109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.554657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f846765-2b57-4830-9ecc-7d3a8a93f109 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.565136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1231/2460] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:50:04.569102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208dd4c-40f6-4b51-9b3e-d35bf83348f0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.584157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208dd4c-40f6-4b51-9b3e-d35bf83348f0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.593794 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d860b-1772-4965-adec-3ff7d9ecd68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.594707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d860b-1772-4965-adec-3ff7d9ecd68d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.594978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d860b-1772-4965-adec-3ff7d9ecd68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.595850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d860b-1772-4965-adec-3ff7d9ecd68d admin admin] PATH_INFO: `/v3/projects/469387c33ec741aa98447afd6e635335/users/413b86d3f3be43daada8246b822c01a5/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.610348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d860b-1772-4965-adec-3ff7d9ecd68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=469387c33ec741aa98447afd6e635335, user_id=413b86d3f3be43daada8246b822c01a5, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.613014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d860b-1772-4965-adec-3ff7d9ecd68d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.625135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1230/2461] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:50:04 2022] PUT /identity/v3/projects/469387c33ec741aa98447afd6e635335/users/413b86d3f3be43daada8246b822c01a5/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:50:04.629088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f846765-2b57-4830-9ecc-7d3a8a93f109 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.638972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f846765-2b57-4830-9ecc-7d3a8a93f109 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.692913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083039d-449e-4d97-81d0-121313f13609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.693485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083039d-449e-4d97-81d0-121313f13609 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.693770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083039d-449e-4d97-81d0-121313f13609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.694069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083039d-449e-4d97-81d0-121313f13609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.694782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083039d-449e-4d97-81d0-121313f13609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.696363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083039d-449e-4d97-81d0-121313f13609 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.706133 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1232/2462] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:04.710135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d860b-1772-4965-adec-3ff7d9ecd68d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.721163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d860b-1772-4965-adec-3ff7d9ecd68d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.725902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b528f-91e9-4a98-ac58-a410d4734d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.726798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b528f-91e9-4a98-ac58-a410d4734d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.727080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b528f-91e9-4a98-ac58-a410d4734d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.727635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b528f-91e9-4a98-ac58-a410d4734d23 admin admin] PATH_INFO: `/v3/projects/469387c33ec741aa98447afd6e635335/users/413b86d3f3be43daada8246b822c01a5/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.729574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b528f-91e9-4a98-ac58-a410d4734d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469387c33ec741aa98447afd6e635335, user_id=413b86d3f3be43daada8246b822c01a5, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.732243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b528f-91e9-4a98-ac58-a410d4734d23 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.742189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1231/2463] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:50:04 2022] PUT /identity/v3/projects/469387c33ec741aa98447afd6e635335/users/413b86d3f3be43daada8246b822c01a5/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:04.754511 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09931-8823-493b-9f35-051ae3efdc33 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.754919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09931-8823-493b-9f35-051ae3efdc33 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.755112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09931-8823-493b-9f35-051ae3efdc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.780842 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-09d09931-8823-493b-9f35-051ae3efdc33 None None] MFA Rules not processed for user `413b86d3f3be43daada8246b822c01a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:04.782059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-09d09931-8823-493b-9f35-051ae3efdc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:04.846659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1233/2464] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:04.857555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b528f-91e9-4a98-ac58-a410d4734d23 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:04.859344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f93b528f-91e9-4a98-ac58-a410d4734d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:04.914717 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b528f-91e9-4a98-ac58-a410d4734d23 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:04.918371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd4167-4fa9-445b-b9b8-860e1f2b38c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:04.919000 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd4167-4fa9-445b-b9b8-860e1f2b38c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:04.919276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd4167-4fa9-445b-b9b8-860e1f2b38c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:04.919546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd4167-4fa9-445b-b9b8-860e1f2b38c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:04.928964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd4167-4fa9-445b-b9b8-860e1f2b38c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:04.930437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd4167-4fa9-445b-b9b8-860e1f2b38c6 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:04.941459 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1232/2465] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:05.016797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d09931-8823-493b-9f35-051ae3efdc33 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:05.026049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d09931-8823-493b-9f35-051ae3efdc33 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:05.029584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf63d8-fbfe-40d0-8e25-12b86420937c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:05.030246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf63d8-fbfe-40d0-8e25-12b86420937c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:05.030590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf63d8-fbfe-40d0-8e25-12b86420937c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:05.030800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf63d8-fbfe-40d0-8e25-12b86420937c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:05.086178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf63d8-fbfe-40d0-8e25-12b86420937c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:05.087589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf63d8-fbfe-40d0-8e25-12b86420937c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:05.096567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1234/2466] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:09.077359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd4167-4fa9-445b-b9b8-860e1f2b38c6 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:09.135940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd4167-4fa9-445b-b9b8-860e1f2b38c6 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:09.140491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:09.141341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:09.141622 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:09.142415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] PATH_INFO: `/v3/users/2e64bc19c0a144a5a680b9e25a492720` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:09.143608 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e64bc19c0a144a5a680b9e25a492720)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:09.145523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:09.189437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e64bc19c0a144a5a680b9e25a492720'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.200388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e64bc19c0a144a5a680b9e25a492720'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.201027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e64bc19c0a144a5a680b9e25a492720'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.201676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e64bc19c0a144a5a680b9e25a492720'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.208958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e64bc19c0a144a5a680b9e25a492720'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.222697 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1233/2467] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:50:09 2022] DELETE /identity/v3/users/2e64bc19c0a144a5a680b9e25a492720 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:09.227458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c68f-73b3-430d-a1c6-6bb8da45a567 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:09.227945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c68f-73b3-430d-a1c6-6bb8da45a567 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:09.228050 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c68f-73b3-430d-a1c6-6bb8da45a567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:09.244376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a3c9c68f-73b3-430d-a1c6-6bb8da45a567 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:09.245653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a3c9c68f-73b3-430d-a1c6-6bb8da45a567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:09.303711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1235/2468] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:09.313036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:09.314467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:09.369339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12ac36-75b7-4be8-8ec2-f67572b2bed1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:09.373032 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e996a6-589f-4873-b74c-c977ccb12a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:09.373658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e996a6-589f-4873-b74c-c977ccb12a11 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:09.373938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e996a6-589f-4873-b74c-c977ccb12a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:09.374245 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e996a6-589f-4873-b74c-c977ccb12a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:09.382992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e996a6-589f-4873-b74c-c977ccb12a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:09.384419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e996a6-589f-4873-b74c-c977ccb12a11 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:09.394171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1234/2469] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:09.648150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c68f-73b3-430d-a1c6-6bb8da45a567 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:09.649575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a3c9c68f-73b3-430d-a1c6-6bb8da45a567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:09.661514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c68f-73b3-430d-a1c6-6bb8da45a567 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:09.666411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:09.667321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:09.667619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:09.667873 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] PATH_INFO: `/v3/projects/faec257af3ac45b9812739edbfa71ad1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:09.669717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faec257af3ac45b9812739edbfa71ad1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:09.671763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:09.722058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faec257af3ac45b9812739edbfa71ad1', 'request_id': 'req-7985c19d-58ce-4161-ad93-23cd16d18a40'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.729258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faec257af3ac45b9812739edbfa71ad1', 'request_id': 'req-7985c19d-58ce-4161-ad93-23cd16d18a40'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.737885 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faec257af3ac45b9812739edbfa71ad1', 'request_id': 'req-7985c19d-58ce-4161-ad93-23cd16d18a40'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.755782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] The token cache is being invalidate because project faec257af3ac45b9812739edbfa71ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:50:09.756063 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.756719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.758782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1236/2470] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:50:09 2022] DELETE /identity/v3/projects/faec257af3ac45b9812739edbfa71ad1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:09.762465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e996a6-589f-4873-b74c-c977ccb12a11 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:09.773352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e996a6-589f-4873-b74c-c977ccb12a11 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:09.830833 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:09.831734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:09.832155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:09.832435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] PATH_INFO: `/v3/users/413b86d3f3be43daada8246b822c01a5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:09.833628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] RBAC: Authorizing `identity:delete_user(user_id=413b86d3f3be43daada8246b822c01a5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:09.835606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:09.879122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413b86d3f3be43daada8246b822c01a5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.890269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413b86d3f3be43daada8246b822c01a5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.890925 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413b86d3f3be43daada8246b822c01a5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.891537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413b86d3f3be43daada8246b822c01a5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.898113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f3475b4b-d972-422c-b779-4b95e40e056f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413b86d3f3be43daada8246b822c01a5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:09.910241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1235/2471] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:50:09 2022] DELETE /identity/v3/users/413b86d3f3be43daada8246b822c01a5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:10.175084 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:10.176603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:10.190194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985c19d-58ce-4161-ad93-23cd16d18a40 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:10.245528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:10.246446 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.246729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.247004 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] PATH_INFO: `/v3/projects/469387c33ec741aa98447afd6e635335` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.248205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=469387c33ec741aa98447afd6e635335)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:10.250145 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:10.294397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469387c33ec741aa98447afd6e635335', 'request_id': 'req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:10.301949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469387c33ec741aa98447afd6e635335', 'request_id': 'req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:10.314180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469387c33ec741aa98447afd6e635335', 'request_id': 'req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:10.326484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] The token cache is being invalidate because project 469387c33ec741aa98447afd6e635335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:50:10.326774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:10.327408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbfecaa9-d3e8-4b7d-8ec8-1b7c8ff27f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:10.328969 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1237/2472] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:50:10 2022] DELETE /identity/v3/projects/469387c33ec741aa98447afd6e635335 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:50:10.336749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78e1e-d216-4a35-bac0-31ce70fea17c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.337276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78e1e-d216-4a35-bac0-31ce70fea17c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.337567 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78e1e-d216-4a35-bac0-31ce70fea17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.358523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-92b78e1e-d216-4a35-bac0-31ce70fea17c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:10.359761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-92b78e1e-d216-4a35-bac0-31ce70fea17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:10.416379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1236/2473] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:10.424274 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34be6-145f-47ee-b67a-d5244d4087a9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.424568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34be6-145f-47ee-b67a-d5244d4087a9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.424852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34be6-145f-47ee-b67a-d5244d4087a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.442901 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0fa34be6-145f-47ee-b67a-d5244d4087a9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:10.444138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0fa34be6-145f-47ee-b67a-d5244d4087a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:10.452014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1238/2474] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:10.456689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b78e1e-d216-4a35-bac0-31ce70fea17c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:10.466053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b78e1e-d216-4a35-bac0-31ce70fea17c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:10.470587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdbf47-dee4-42bb-bd79-6d675d77ebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:10.471230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbf47-dee4-42bb-bd79-6d675d77ebdc admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.471524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbf47-dee4-42bb-bd79-6d675d77ebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.471787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbf47-dee4-42bb-bd79-6d675d77ebdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.472508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdbf47-dee4-42bb-bd79-6d675d77ebdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:50:10.472813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdbf47-dee4-42bb-bd79-6d675d77ebdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:10.474438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdbf47-dee4-42bb-bd79-6d675d77ebdc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:10.485952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1237/2475] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:50:10.489960 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa34be6-145f-47ee-b67a-d5244d4087a9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:10.498981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa34be6-145f-47ee-b67a-d5244d4087a9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:10.504096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f920df5-ed6c-4a92-9787-887fa43652e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:10.504733 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f920df5-ed6c-4a92-9787-887fa43652e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.505015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f920df5-ed6c-4a92-9787-887fa43652e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.505291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f920df5-ed6c-4a92-9787-887fa43652e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.505977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f920df5-ed6c-4a92-9787-887fa43652e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:10.507898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f920df5-ed6c-4a92-9787-887fa43652e9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:10.533140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1239/2476] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:50:10 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:50:10.537044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdbf47-dee4-42bb-bd79-6d675d77ebdc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:10.547118 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdbf47-dee4-42bb-bd79-6d675d77ebdc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:10.600741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce0d02-a0a4-4f36-b090-f72ca8235ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:10.601394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce0d02-a0a4-4f36-b090-f72ca8235ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.601674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce0d02-a0a4-4f36-b090-f72ca8235ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.601954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce0d02-a0a4-4f36-b090-f72ca8235ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.602924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce0d02-a0a4-4f36-b090-f72ca8235ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:10.604834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce0d02-a0a4-4f36-b090-f72ca8235ad5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:10.623698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1238/2477] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:50:10 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:50:10.627756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f920df5-ed6c-4a92-9787-887fa43652e9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:10.637742 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f920df5-ed6c-4a92-9787-887fa43652e9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:10.642953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88559d-0acb-4442-b6fa-b7a4a0a1d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:10.643609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88559d-0acb-4442-b6fa-b7a4a0a1d5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.643895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88559d-0acb-4442-b6fa-b7a4a0a1d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.644173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88559d-0acb-4442-b6fa-b7a4a0a1d5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.645293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88559d-0acb-4442-b6fa-b7a4a0a1d5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:10.647060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88559d-0acb-4442-b6fa-b7a4a0a1d5bf admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:10.660473 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1240/2478] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:50:10.664691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce0d02-a0a4-4f36-b090-f72ca8235ad5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:10.674693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce0d02-a0a4-4f36-b090-f72ca8235ad5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:10.679268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c878105-19fc-49a7-a613-6859a179240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:10.679921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878105-19fc-49a7-a613-6859a179240a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.680198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878105-19fc-49a7-a613-6859a179240a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.680469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878105-19fc-49a7-a613-6859a179240a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.681174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c878105-19fc-49a7-a613-6859a179240a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:10.682785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c878105-19fc-49a7-a613-6859a179240a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:10.692175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1239/2479] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:10.695973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88559d-0acb-4442-b6fa-b7a4a0a1d5bf admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:10.705994 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88559d-0acb-4442-b6fa-b7a4a0a1d5bf admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:10.710761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718a39-11d5-4c90-bb93-6a457522db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:10.711651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718a39-11d5-4c90-bb93-6a457522db67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.711927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718a39-11d5-4c90-bb93-6a457522db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.712199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718a39-11d5-4c90-bb93-6a457522db67 admin admin] PATH_INFO: `/v3/projects/56d32bd5d5ce49a487f84b8b8a85d2a4/users/4b92bd38402e41c587b56d62165c6702/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.726951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07718a39-11d5-4c90-bb93-6a457522db67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d32bd5d5ce49a487f84b8b8a85d2a4, user_id=4b92bd38402e41c587b56d62165c6702, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:10.729841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07718a39-11d5-4c90-bb93-6a457522db67 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:10.742111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1241/2480] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:50:10 2022] PUT /identity/v3/projects/56d32bd5d5ce49a487f84b8b8a85d2a4/users/4b92bd38402e41c587b56d62165c6702/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:10.754055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833405f8-a8be-4db6-aaf4-4f11cd6fdc0d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.754349 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833405f8-a8be-4db6-aaf4-4f11cd6fdc0d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.754647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833405f8-a8be-4db6-aaf4-4f11cd6fdc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.780396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-833405f8-a8be-4db6-aaf4-4f11cd6fdc0d None None] MFA Rules not processed for user `4b92bd38402e41c587b56d62165c6702`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:10.781575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-833405f8-a8be-4db6-aaf4-4f11cd6fdc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:10.841271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1240/2481] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:10.852459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718a39-11d5-4c90-bb93-6a457522db67 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:10.854186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-07718a39-11d5-4c90-bb93-6a457522db67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:10.909182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718a39-11d5-4c90-bb93-6a457522db67 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:10.912719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691538e3-a8c2-4fab-b4a6-ba7d0090cd05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:10.913350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691538e3-a8c2-4fab-b4a6-ba7d0090cd05 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:10.913629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691538e3-a8c2-4fab-b4a6-ba7d0090cd05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:10.913903 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691538e3-a8c2-4fab-b4a6-ba7d0090cd05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:10.922012 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691538e3-a8c2-4fab-b4a6-ba7d0090cd05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:10.923933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691538e3-a8c2-4fab-b4a6-ba7d0090cd05 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:10.932410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1242/2482] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:10.951807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833405f8-a8be-4db6-aaf4-4f11cd6fdc0d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:11.011861 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833405f8-a8be-4db6-aaf4-4f11cd6fdc0d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:11.016354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:11.017192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.017466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.017732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] PATH_INFO: `/v3/users/4b92bd38402e41c587b56d62165c6702` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.018928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b92bd38402e41c587b56d62165c6702)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:11.020828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:11.064457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b92bd38402e41c587b56d62165c6702'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.075581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b92bd38402e41c587b56d62165c6702'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.076238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b92bd38402e41c587b56d62165c6702'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.076848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b92bd38402e41c587b56d62165c6702'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.084203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b92bd38402e41c587b56d62165c6702'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.096891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1241/2483] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:50:10 2022] DELETE /identity/v3/users/4b92bd38402e41c587b56d62165c6702 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:11.101522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d5cb-f31f-4b6b-ba27-19f8f2bf49c7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.101815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d5cb-f31f-4b6b-ba27-19f8f2bf49c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.102364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d5cb-f31f-4b6b-ba27-19f8f2bf49c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.119229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5243d5cb-f31f-4b6b-ba27-19f8f2bf49c7 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:11.120407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5243d5cb-f31f-4b6b-ba27-19f8f2bf49c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:11.176203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1243/2484] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:11.185864 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:11.187318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:11.242211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748ae29-d69f-425b-a744-cf1d3e3ffbb3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:11.245856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be1333-0e68-4752-a2ce-00329556ab6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:11.246531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be1333-0e68-4752-a2ce-00329556ab6d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.246811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be1333-0e68-4752-a2ce-00329556ab6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.247121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be1333-0e68-4752-a2ce-00329556ab6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.256354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be1333-0e68-4752-a2ce-00329556ab6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:11.257768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be1333-0e68-4752-a2ce-00329556ab6d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:11.267960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1242/2485] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:11.519389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243d5cb-f31f-4b6b-ba27-19f8f2bf49c7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:11.520919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5243d5cb-f31f-4b6b-ba27-19f8f2bf49c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:11.535621 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243d5cb-f31f-4b6b-ba27-19f8f2bf49c7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:11.541135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:11.541921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.542325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.542611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] PATH_INFO: `/v3/projects/56d32bd5d5ce49a487f84b8b8a85d2a4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.544570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d32bd5d5ce49a487f84b8b8a85d2a4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:11.546521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:11.591358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d32bd5d5ce49a487f84b8b8a85d2a4', 'request_id': 'req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.597321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d32bd5d5ce49a487f84b8b8a85d2a4', 'request_id': 'req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.604920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d32bd5d5ce49a487f84b8b8a85d2a4', 'request_id': 'req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.615311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] The token cache is being invalidate because project 56d32bd5d5ce49a487f84b8b8a85d2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:50:11.615596 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.616206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75afa81e-1fcd-4b69-8a55-e4c1ae8bfde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:11.617717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1244/2486] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:50:11 2022] DELETE /identity/v3/projects/56d32bd5d5ce49a487f84b8b8a85d2a4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:50:11.622616 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e15cc-2327-4a2d-ac24-4d82c2694541 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.623096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e15cc-2327-4a2d-ac24-4d82c2694541 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.623200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e15cc-2327-4a2d-ac24-4d82c2694541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.640592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-de2e15cc-2327-4a2d-ac24-4d82c2694541 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:11.641815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-de2e15cc-2327-4a2d-ac24-4d82c2694541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:11.704927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1243/2487] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:11.712745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b13d90-aad8-48b6-8431-67bfa068394f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.713032 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b13d90-aad8-48b6-8431-67bfa068394f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.713315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b13d90-aad8-48b6-8431-67bfa068394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.732713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-94b13d90-aad8-48b6-8431-67bfa068394f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:11.733930 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-94b13d90-aad8-48b6-8431-67bfa068394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:11.742608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1245/2488] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:11.747049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e15cc-2327-4a2d-ac24-4d82c2694541 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:11.757179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e15cc-2327-4a2d-ac24-4d82c2694541 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:11.761737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599bfee-20a2-4f7f-8f3b-c8bf383cb7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:11.762428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599bfee-20a2-4f7f-8f3b-c8bf383cb7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.762707 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599bfee-20a2-4f7f-8f3b-c8bf383cb7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.762982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599bfee-20a2-4f7f-8f3b-c8bf383cb7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.763698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599bfee-20a2-4f7f-8f3b-c8bf383cb7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:50:11.764006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599bfee-20a2-4f7f-8f3b-c8bf383cb7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:11.765597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599bfee-20a2-4f7f-8f3b-c8bf383cb7ab admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:11.776664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1244/2489] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:50:11.780836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b13d90-aad8-48b6-8431-67bfa068394f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:11.790352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b13d90-aad8-48b6-8431-67bfa068394f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:11.794889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7c28f-4d17-48fe-a7b2-53d9695223e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:11.795520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c28f-4d17-48fe-a7b2-53d9695223e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.795796 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c28f-4d17-48fe-a7b2-53d9695223e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.796067 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c28f-4d17-48fe-a7b2-53d9695223e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.796749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7c28f-4d17-48fe-a7b2-53d9695223e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:11.799294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7c28f-4d17-48fe-a7b2-53d9695223e7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:11.826249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1246/2490] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:50:11 2022] POST /identity/v3/projects => generated 359 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:50:11.827433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599bfee-20a2-4f7f-8f3b-c8bf383cb7ab admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:11.837072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599bfee-20a2-4f7f-8f3b-c8bf383cb7ab admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:11.892785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3384e-7ce3-4792-a75d-fd9406a8d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:11.892785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3384e-7ce3-4792-a75d-fd9406a8d165 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.892785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3384e-7ce3-4792-a75d-fd9406a8d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.893174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3384e-7ce3-4792-a75d-fd9406a8d165 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.893713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3384e-7ce3-4792-a75d-fd9406a8d165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:11.895645 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3384e-7ce3-4792-a75d-fd9406a8d165 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:11.914136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1245/2491] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:50:11 2022] POST /identity/v3/users => generated 280 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:50:11.918115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7c28f-4d17-48fe-a7b2-53d9695223e7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:11.928595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7c28f-4d17-48fe-a7b2-53d9695223e7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:11.933105 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95910565-a98d-42fd-88a3-b444f1fbeada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:11.933745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95910565-a98d-42fd-88a3-b444f1fbeada admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.934055 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95910565-a98d-42fd-88a3-b444f1fbeada admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.934332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95910565-a98d-42fd-88a3-b444f1fbeada admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.935052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95910565-a98d-42fd-88a3-b444f1fbeada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:11.936627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95910565-a98d-42fd-88a3-b444f1fbeada admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:11.946729 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1247/2492] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:11.950392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3384e-7ce3-4792-a75d-fd9406a8d165 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:11.959860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3384e-7ce3-4792-a75d-fd9406a8d165 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:11.964347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311efe9-d9ba-4503-ab9d-7454d30d41f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:11.964985 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311efe9-d9ba-4503-ab9d-7454d30d41f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.965265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311efe9-d9ba-4503-ab9d-7454d30d41f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.965540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311efe9-d9ba-4503-ab9d-7454d30d41f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:11.966281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311efe9-d9ba-4503-ab9d-7454d30d41f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:11.967858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311efe9-d9ba-4503-ab9d-7454d30d41f2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:11.978242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1246/2493] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:11.982560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95910565-a98d-42fd-88a3-b444f1fbeada admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:11.993269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95910565-a98d-42fd-88a3-b444f1fbeada admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:11.998234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cd37f-3281-42ed-a7a6-bc8e35d794ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:11.999124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cd37f-3281-42ed-a7a6-bc8e35d794ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:11.999402 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cd37f-3281-42ed-a7a6-bc8e35d794ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:11.999673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cd37f-3281-42ed-a7a6-bc8e35d794ad admin admin] PATH_INFO: `/v3/projects/f1c8877d0ed641f8bd58a6bf85c0099e/users/072e369ac4494aa3bb7ec5aa4f00bc41/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:12.021295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cd37f-3281-42ed-a7a6-bc8e35d794ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c8877d0ed641f8bd58a6bf85c0099e, user_id=072e369ac4494aa3bb7ec5aa4f00bc41, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:12.023972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cd37f-3281-42ed-a7a6-bc8e35d794ad admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:12.037248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1248/2494] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:50:11 2022] PUT /identity/v3/projects/f1c8877d0ed641f8bd58a6bf85c0099e/users/072e369ac4494aa3bb7ec5aa4f00bc41/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:50:12.049706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5107-9bbc-41aa-97a2-d0c51c23e181 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:12.050011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5107-9bbc-41aa-97a2-d0c51c23e181 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:12.050375 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5107-9bbc-41aa-97a2-d0c51c23e181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:12.076265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-310c5107-9bbc-41aa-97a2-d0c51c23e181 None None] MFA Rules not processed for user `072e369ac4494aa3bb7ec5aa4f00bc41`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:12.077495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-310c5107-9bbc-41aa-97a2-d0c51c23e181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:12.139129 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1247/2495] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:12.170797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cd37f-3281-42ed-a7a6-bc8e35d794ad admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:12.172522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8c1cd37f-3281-42ed-a7a6-bc8e35d794ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:12.227744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cd37f-3281-42ed-a7a6-bc8e35d794ad admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:12.231292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f406e9b-be73-409f-bf6e-8795ea6c19c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:12.231936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406e9b-be73-409f-bf6e-8795ea6c19c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:12.232227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406e9b-be73-409f-bf6e-8795ea6c19c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:12.232494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406e9b-be73-409f-bf6e-8795ea6c19c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:12.240927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f406e9b-be73-409f-bf6e-8795ea6c19c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:12.242377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f406e9b-be73-409f-bf6e-8795ea6c19c0 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:12.250910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1249/2496] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:12.265275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c5107-9bbc-41aa-97a2-d0c51c23e181 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:12.336655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c5107-9bbc-41aa-97a2-d0c51c23e181 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:12.341850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:12.342816 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:12.343204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:12.343528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] PATH_INFO: `/v3/users/072e369ac4494aa3bb7ec5aa4f00bc41` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:12.345563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072e369ac4494aa3bb7ec5aa4f00bc41)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:12.347807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:12.402117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072e369ac4494aa3bb7ec5aa4f00bc41'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.414049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072e369ac4494aa3bb7ec5aa4f00bc41'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.414735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072e369ac4494aa3bb7ec5aa4f00bc41'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.415372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072e369ac4494aa3bb7ec5aa4f00bc41'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.421978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072e369ac4494aa3bb7ec5aa4f00bc41'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.434307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1248/2497] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:50:12 2022] DELETE /identity/v3/users/072e369ac4494aa3bb7ec5aa4f00bc41 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:50:12.439360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8af2a-efca-42ef-94aa-f2bee83b74ff None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:12.439667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8af2a-efca-42ef-94aa-f2bee83b74ff None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:12.439946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8af2a-efca-42ef-94aa-f2bee83b74ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:12.457054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bbf8af2a-efca-42ef-94aa-f2bee83b74ff None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:12.458286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bbf8af2a-efca-42ef-94aa-f2bee83b74ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:12.513709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1250/2498] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:12.523499 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:12.524881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:12.578526 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b469c-b5df-4910-bfaa-47ff8cbfeae8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:12.582720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3f78e-d305-4bb3-bf07-94b63aa4c950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:12.583350 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3f78e-d305-4bb3-bf07-94b63aa4c950 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:12.583632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3f78e-d305-4bb3-bf07-94b63aa4c950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:12.583907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3f78e-d305-4bb3-bf07-94b63aa4c950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:12.592546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3f78e-d305-4bb3-bf07-94b63aa4c950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:12.593962 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3f78e-d305-4bb3-bf07-94b63aa4c950 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:12.603448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1249/2499] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:12.859966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8af2a-efca-42ef-94aa-f2bee83b74ff None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:12.862076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bbf8af2a-efca-42ef-94aa-f2bee83b74ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:12.880022 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8af2a-efca-42ef-94aa-f2bee83b74ff None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:12.885564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:12.886451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:12.886735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:12.887031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] PATH_INFO: `/v3/projects/f1c8877d0ed641f8bd58a6bf85c0099e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:12.888214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c8877d0ed641f8bd58a6bf85c0099e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:12.890136 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:12.935633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c8877d0ed641f8bd58a6bf85c0099e', 'request_id': 'req-edaa0667-6ead-45e4-bfdf-59e8502b6cef'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.942143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c8877d0ed641f8bd58a6bf85c0099e', 'request_id': 'req-edaa0667-6ead-45e4-bfdf-59e8502b6cef'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.949177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c8877d0ed641f8bd58a6bf85c0099e', 'request_id': 'req-edaa0667-6ead-45e4-bfdf-59e8502b6cef'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.959039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] The token cache is being invalidate because project f1c8877d0ed641f8bd58a6bf85c0099e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:50:12.959326 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.959955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-edaa0667-6ead-45e4-bfdf-59e8502b6cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:12.961484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1251/2500] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:50:12 2022] DELETE /identity/v3/projects/f1c8877d0ed641f8bd58a6bf85c0099e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:50:12.966374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddd476-4415-4115-90b8-5d4d9fc9940d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:12.966844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddd476-4415-4115-90b8-5d4d9fc9940d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:12.966968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddd476-4415-4115-90b8-5d4d9fc9940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:12.984187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-54ddd476-4415-4115-90b8-5d4d9fc9940d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:12.985373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-54ddd476-4415-4115-90b8-5d4d9fc9940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:13.041304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1250/2501] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:13.050358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679b24a-5272-46c5-895b-5526f7cdbcb2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:13.050651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679b24a-5272-46c5-895b-5526f7cdbcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:13.050933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679b24a-5272-46c5-895b-5526f7cdbcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:13.069413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2679b24a-5272-46c5-895b-5526f7cdbcb2 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:13.070645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2679b24a-5272-46c5-895b-5526f7cdbcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:13.078514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1252/2502] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:13.082583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddd476-4415-4115-90b8-5d4d9fc9940d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:13.091893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddd476-4415-4115-90b8-5d4d9fc9940d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:13.096530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c26b22-2a9e-4211-84bc-c06942c59f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:13.097175 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c26b22-2a9e-4211-84bc-c06942c59f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:13.097458 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c26b22-2a9e-4211-84bc-c06942c59f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:13.097734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c26b22-2a9e-4211-84bc-c06942c59f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:13.098490 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c26b22-2a9e-4211-84bc-c06942c59f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:50:13.098798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c26b22-2a9e-4211-84bc-c06942c59f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:13.100388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c26b22-2a9e-4211-84bc-c06942c59f93 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:13.112173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1251/2503] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:50:13.116372 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679b24a-5272-46c5-895b-5526f7cdbcb2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:13.125400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679b24a-5272-46c5-895b-5526f7cdbcb2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:13.130614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66d0f9-debe-4824-847b-07590936a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:13.131257 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66d0f9-debe-4824-847b-07590936a661 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:13.131541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66d0f9-debe-4824-847b-07590936a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:13.131822 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66d0f9-debe-4824-847b-07590936a661 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:13.132521 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66d0f9-debe-4824-847b-07590936a661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:13.134460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66d0f9-debe-4824-847b-07590936a661 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:13.159895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1253/2504] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:50:13 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:50:13.163881 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c26b22-2a9e-4211-84bc-c06942c59f93 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:13.173519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c26b22-2a9e-4211-84bc-c06942c59f93 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:13.226854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41dbbc-b0e6-453e-825d-576b722624cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:13.227768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41dbbc-b0e6-453e-825d-576b722624cc admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:13.228052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41dbbc-b0e6-453e-825d-576b722624cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:13.228326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41dbbc-b0e6-453e-825d-576b722624cc admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:13.229010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41dbbc-b0e6-453e-825d-576b722624cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:13.230960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41dbbc-b0e6-453e-825d-576b722624cc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:13.250058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1252/2505] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:50:13 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:50:13.254520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66d0f9-debe-4824-847b-07590936a661 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:13.264501 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66d0f9-debe-4824-847b-07590936a661 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:13.269944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e72a0-337f-45e2-ad8f-a31127e64618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:13.270629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e72a0-337f-45e2-ad8f-a31127e64618 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:13.270917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e72a0-337f-45e2-ad8f-a31127e64618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:13.271197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e72a0-337f-45e2-ad8f-a31127e64618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:13.271926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e72a0-337f-45e2-ad8f-a31127e64618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:13.273557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e72a0-337f-45e2-ad8f-a31127e64618 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:13.284811 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1254/2506] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:13.288391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41dbbc-b0e6-453e-825d-576b722624cc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:13.298126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41dbbc-b0e6-453e-825d-576b722624cc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:13.302691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b1ba-23e3-4da5-809c-d187d305ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:13.303407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b1ba-23e3-4da5-809c-d187d305ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:13.303689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b1ba-23e3-4da5-809c-d187d305ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:13.303965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b1ba-23e3-4da5-809c-d187d305ccf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:13.304683 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677b1ba-23e3-4da5-809c-d187d305ccf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:13.306304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677b1ba-23e3-4da5-809c-d187d305ccf3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:13.318208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1253/2507] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:13.322218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e72a0-337f-45e2-ad8f-a31127e64618 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:13.332524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e72a0-337f-45e2-ad8f-a31127e64618 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:13.337154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d418f6-a6aa-4fd6-a4c8-1fe37cc75adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:13.338021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d418f6-a6aa-4fd6-a4c8-1fe37cc75adf admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:13.338323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d418f6-a6aa-4fd6-a4c8-1fe37cc75adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:13.338596 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d418f6-a6aa-4fd6-a4c8-1fe37cc75adf admin admin] PATH_INFO: `/v3/projects/4f5faad12ace4644ae90f61be4d40da5/users/c4a812d4582841918ff99a6daafbef09/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:13.352625 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d418f6-a6aa-4fd6-a4c8-1fe37cc75adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5faad12ace4644ae90f61be4d40da5, user_id=c4a812d4582841918ff99a6daafbef09, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:13.355305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d418f6-a6aa-4fd6-a4c8-1fe37cc75adf admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:13.367764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1255/2508] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:50:13 2022] PUT /identity/v3/projects/4f5faad12ace4644ae90f61be4d40da5/users/c4a812d4582841918ff99a6daafbef09/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:13.378332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc1aed-8e1a-4e36-a705-64b7f7a24863 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:13.378619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc1aed-8e1a-4e36-a705-64b7f7a24863 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:13.378892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc1aed-8e1a-4e36-a705-64b7f7a24863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:13.404272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-10fc1aed-8e1a-4e36-a705-64b7f7a24863 None None] MFA Rules not processed for user `c4a812d4582841918ff99a6daafbef09`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:13.405472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-10fc1aed-8e1a-4e36-a705-64b7f7a24863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:13.467372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1254/2509] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:13.478489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d418f6-a6aa-4fd6-a4c8-1fe37cc75adf admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:13.480190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-23d418f6-a6aa-4fd6-a4c8-1fe37cc75adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:13.539356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d418f6-a6aa-4fd6-a4c8-1fe37cc75adf admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:13.543241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c6c8e-385c-4889-b274-453ebb9b8f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:13.543908 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c6c8e-385c-4889-b274-453ebb9b8f8e service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:13.544216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c6c8e-385c-4889-b274-453ebb9b8f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:13.544624 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c6c8e-385c-4889-b274-453ebb9b8f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:13.554500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c6c8e-385c-4889-b274-453ebb9b8f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:13.555849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c6c8e-385c-4889-b274-453ebb9b8f8e service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:13.564638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1256/2510] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:23.285116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc1aed-8e1a-4e36-a705-64b7f7a24863 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:23.344192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc1aed-8e1a-4e36-a705-64b7f7a24863 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:23.348671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:23.349525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:23.349802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:23.350103 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] PATH_INFO: `/v3/users/c4a812d4582841918ff99a6daafbef09` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:23.351272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a812d4582841918ff99a6daafbef09)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:23.353434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:23.397154 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a812d4582841918ff99a6daafbef09'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.408341 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a812d4582841918ff99a6daafbef09'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.409018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a812d4582841918ff99a6daafbef09'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.409620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a812d4582841918ff99a6daafbef09'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.416282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a812d4582841918ff99a6daafbef09'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.429585 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1255/2511] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:50:23 2022] DELETE /identity/v3/users/c4a812d4582841918ff99a6daafbef09 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:23.434172 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960aafa6-acb1-4253-95a0-0c8c773827cd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:23.434633 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960aafa6-acb1-4253-95a0-0c8c773827cd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:23.434728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960aafa6-acb1-4253-95a0-0c8c773827cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:23.451588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-960aafa6-acb1-4253-95a0-0c8c773827cd None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:23.452786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-960aafa6-acb1-4253-95a0-0c8c773827cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:23.508479 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1257/2512] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:23.518740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:23.520143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:23.575053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412165be-e415-43f6-8658-d612f730a4b7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:23.578734 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ec5c-1008-4839-8ed3-0c89bfd7634d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:23.579374 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ec5c-1008-4839-8ed3-0c89bfd7634d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:23.579654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ec5c-1008-4839-8ed3-0c89bfd7634d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:23.579926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ec5c-1008-4839-8ed3-0c89bfd7634d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:23.588733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ec5c-1008-4839-8ed3-0c89bfd7634d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:23.590201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ec5c-1008-4839-8ed3-0c89bfd7634d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:23.600104 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1256/2513] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:23.855313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960aafa6-acb1-4253-95a0-0c8c773827cd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:23.857253 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-960aafa6-acb1-4253-95a0-0c8c773827cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:23.872300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960aafa6-acb1-4253-95a0-0c8c773827cd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:23.881700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:23.882608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:23.887010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:23.887010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] PATH_INFO: `/v3/projects/4f5faad12ace4644ae90f61be4d40da5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:23.887010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5faad12ace4644ae90f61be4d40da5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:23.887010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:23.932135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5faad12ace4644ae90f61be4d40da5', 'request_id': 'req-f393fbf1-9417-4897-ad78-9a5fefa738ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.938170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5faad12ace4644ae90f61be4d40da5', 'request_id': 'req-f393fbf1-9417-4897-ad78-9a5fefa738ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.946410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5faad12ace4644ae90f61be4d40da5', 'request_id': 'req-f393fbf1-9417-4897-ad78-9a5fefa738ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.956069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] The token cache is being invalidate because project 4f5faad12ace4644ae90f61be4d40da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:50:23.956475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.957150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f393fbf1-9417-4897-ad78-9a5fefa738ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:23.958876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1258/2514] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:50:23 2022] DELETE /identity/v3/projects/4f5faad12ace4644ae90f61be4d40da5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:23.963748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a6bb6-3abf-43ea-89a6-f9dcba377fc8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:23.964038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a6bb6-3abf-43ea-89a6-f9dcba377fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:23.964317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a6bb6-3abf-43ea-89a6-f9dcba377fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:23.981897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fc4a6bb6-3abf-43ea-89a6-f9dcba377fc8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:23.983112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fc4a6bb6-3abf-43ea-89a6-f9dcba377fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:24.038775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1257/2515] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:24.046345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b149a-fb1f-4b02-835f-72f9b497e47b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:24.046757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b149a-fb1f-4b02-835f-72f9b497e47b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:24.047040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b149a-fb1f-4b02-835f-72f9b497e47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:24.065292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f23b149a-fb1f-4b02-835f-72f9b497e47b None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:24.066513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f23b149a-fb1f-4b02-835f-72f9b497e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:24.074273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1259/2516] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:24.078169 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a6bb6-3abf-43ea-89a6-f9dcba377fc8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:24.087937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a6bb6-3abf-43ea-89a6-f9dcba377fc8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:24.092510 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3f8c1-5b05-4818-b05a-5f7a9fc9a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:24.093155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3f8c1-5b05-4818-b05a-5f7a9fc9a67b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:24.093437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3f8c1-5b05-4818-b05a-5f7a9fc9a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:24.093730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3f8c1-5b05-4818-b05a-5f7a9fc9a67b admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:24.094471 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3f8c1-5b05-4818-b05a-5f7a9fc9a67b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:50:24.095357 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3f8c1-5b05-4818-b05a-5f7a9fc9a67b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:24.096940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3f8c1-5b05-4818-b05a-5f7a9fc9a67b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:24.108815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1258/2517] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:50:24.112607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b149a-fb1f-4b02-835f-72f9b497e47b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:24.121779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b149a-fb1f-4b02-835f-72f9b497e47b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:24.126533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c00b3f-7c22-4937-9361-044b97a7eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:24.127227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c00b3f-7c22-4937-9361-044b97a7eb53 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:24.127532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c00b3f-7c22-4937-9361-044b97a7eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:24.127811 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c00b3f-7c22-4937-9361-044b97a7eb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:24.128494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c00b3f-7c22-4937-9361-044b97a7eb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:24.130530 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c00b3f-7c22-4937-9361-044b97a7eb53 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:24.156531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1260/2518] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:50:24 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:50:24.161474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3f8c1-5b05-4818-b05a-5f7a9fc9a67b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:24.171553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3f8c1-5b05-4818-b05a-5f7a9fc9a67b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:24.226594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a12825-9a6f-440c-a6d4-ab9e5edad810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:24.227915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12825-9a6f-440c-a6d4-ab9e5edad810 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:24.228440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12825-9a6f-440c-a6d4-ab9e5edad810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:24.228812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12825-9a6f-440c-a6d4-ab9e5edad810 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:24.229502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a12825-9a6f-440c-a6d4-ab9e5edad810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:24.231713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a12825-9a6f-440c-a6d4-ab9e5edad810 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:24.255300 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1259/2519] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:50:24 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:50:24.259612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c00b3f-7c22-4937-9361-044b97a7eb53 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:24.270392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c00b3f-7c22-4937-9361-044b97a7eb53 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:24.275016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cccb3-d1ed-4624-b92f-d5d1fa94655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:24.275672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cccb3-d1ed-4624-b92f-d5d1fa94655b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:24.275956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cccb3-d1ed-4624-b92f-d5d1fa94655b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:24.276233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cccb3-d1ed-4624-b92f-d5d1fa94655b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:24.276955 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cccb3-d1ed-4624-b92f-d5d1fa94655b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:24.278609 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cccb3-d1ed-4624-b92f-d5d1fa94655b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:24.289487 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1261/2520] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:24.293426 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a12825-9a6f-440c-a6d4-ab9e5edad810 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:24.303151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a12825-9a6f-440c-a6d4-ab9e5edad810 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:24.307745 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e4e11-8338-444d-a802-d1e00ab924f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:24.308387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e4e11-8338-444d-a802-d1e00ab924f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:24.308667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e4e11-8338-444d-a802-d1e00ab924f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:24.308940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e4e11-8338-444d-a802-d1e00ab924f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:24.309654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e4e11-8338-444d-a802-d1e00ab924f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:24.311290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e4e11-8338-444d-a802-d1e00ab924f4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:24.320804 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1260/2521] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:50:24.324599 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cccb3-d1ed-4624-b92f-d5d1fa94655b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:24.334792 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cccb3-d1ed-4624-b92f-d5d1fa94655b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:24.339505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cae255-0aab-4070-b266-5627384d54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:24.340412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cae255-0aab-4070-b266-5627384d54a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:24.340735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cae255-0aab-4070-b266-5627384d54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:24.341042 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cae255-0aab-4070-b266-5627384d54a9 admin admin] PATH_INFO: `/v3/projects/3710ae5816284aa6be7afb1960838fc9/users/cbc79167a1f249f1b85066bcd22aa198/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:24.356589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cae255-0aab-4070-b266-5627384d54a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3710ae5816284aa6be7afb1960838fc9, user_id=cbc79167a1f249f1b85066bcd22aa198, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:24.359310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cae255-0aab-4070-b266-5627384d54a9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:24.371717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1262/2522] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:50:24 2022] PUT /identity/v3/projects/3710ae5816284aa6be7afb1960838fc9/users/cbc79167a1f249f1b85066bcd22aa198/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:24.382482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf307b-10ee-4f05-aa03-50ac7ab28f20 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:24.382771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf307b-10ee-4f05-aa03-50ac7ab28f20 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:24.383047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf307b-10ee-4f05-aa03-50ac7ab28f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:24.409480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-88bf307b-10ee-4f05-aa03-50ac7ab28f20 None None] MFA Rules not processed for user `cbc79167a1f249f1b85066bcd22aa198`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:24.410692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-88bf307b-10ee-4f05-aa03-50ac7ab28f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:24.474951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1261/2523] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:24.486771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cae255-0aab-4070-b266-5627384d54a9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:24.488593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-29cae255-0aab-4070-b266-5627384d54a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:24.548222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cae255-0aab-4070-b266-5627384d54a9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:24.556876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732a877-2d0f-4162-b261-f118411625e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:24.557516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732a877-2d0f-4162-b261-f118411625e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:24.557798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732a877-2d0f-4162-b261-f118411625e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:24.558104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732a877-2d0f-4162-b261-f118411625e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:24.566851 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732a877-2d0f-4162-b261-f118411625e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:24.568262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732a877-2d0f-4162-b261-f118411625e2 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:24.576686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1263/2524] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:33.595558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf307b-10ee-4f05-aa03-50ac7ab28f20 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:33.656731 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf307b-10ee-4f05-aa03-50ac7ab28f20 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:33.661771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:33.662650 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:33.662934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:33.663208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] PATH_INFO: `/v3/users/cbc79167a1f249f1b85066bcd22aa198` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:33.664403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc79167a1f249f1b85066bcd22aa198)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:33.666516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:33.709875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc79167a1f249f1b85066bcd22aa198'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:33.720965 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc79167a1f249f1b85066bcd22aa198'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:33.722209 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc79167a1f249f1b85066bcd22aa198'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:33.722815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc79167a1f249f1b85066bcd22aa198'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:33.729736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc79167a1f249f1b85066bcd22aa198'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:33.742151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1262/2525] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:50:33 2022] DELETE /identity/v3/users/cbc79167a1f249f1b85066bcd22aa198 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:33.746764 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ece0-d449-4927-bf17-8ebd920ec5f4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:33.747226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ece0-d449-4927-bf17-8ebd920ec5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:33.747365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ece0-d449-4927-bf17-8ebd920ec5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:33.764056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7db3ece0-d449-4927-bf17-8ebd920ec5f4 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:33.765261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7db3ece0-d449-4927-bf17-8ebd920ec5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:33.822823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1264/2526] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:33.832901 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:33.834355 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:33.889615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3d339-c98a-42cc-96a6-15d29e1ed86e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:33.893700 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c93434-dbca-4bab-96d9-de4cb2956c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:33.894360 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c93434-dbca-4bab-96d9-de4cb2956c33 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:33.894642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c93434-dbca-4bab-96d9-de4cb2956c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:33.894914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c93434-dbca-4bab-96d9-de4cb2956c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:33.903592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c93434-dbca-4bab-96d9-de4cb2956c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:33.905011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c93434-dbca-4bab-96d9-de4cb2956c33 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:33.914744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1263/2527] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:34.166242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3ece0-d449-4927-bf17-8ebd920ec5f4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:34.167485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7db3ece0-d449-4927-bf17-8ebd920ec5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:34.181880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3ece0-d449-4927-bf17-8ebd920ec5f4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:34.186758 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:34.187707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:34.187905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:34.188184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] PATH_INFO: `/v3/projects/3710ae5816284aa6be7afb1960838fc9` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:34.189418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3710ae5816284aa6be7afb1960838fc9)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:34.191841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:34.236738 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3710ae5816284aa6be7afb1960838fc9', 'request_id': 'req-1de6297b-8028-4b98-890b-52dbeaa9867a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:34.242777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3710ae5816284aa6be7afb1960838fc9', 'request_id': 'req-1de6297b-8028-4b98-890b-52dbeaa9867a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:34.250195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3710ae5816284aa6be7afb1960838fc9', 'request_id': 'req-1de6297b-8028-4b98-890b-52dbeaa9867a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:34.260725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] The token cache is being invalidate because project 3710ae5816284aa6be7afb1960838fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:50:34.261011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:34.261619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1de6297b-8028-4b98-890b-52dbeaa9867a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:50:34.263176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1265/2528] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:50:34 2022] DELETE /identity/v3/projects/3710ae5816284aa6be7afb1960838fc9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:50:51.612653 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c93434-dbca-4bab-96d9-de4cb2956c33 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:51.614236 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b4c93434-dbca-4bab-96d9-de4cb2956c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:51.692376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c93434-dbca-4bab-96d9-de4cb2956c33 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:51.755216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:51.755886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:51.756161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:51.756433 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:51.758340 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:51.769671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:51.771287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:51.781119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1264/2529] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:50:55.384095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983757aa-c3fa-42d4-a9ee-93af5245fa58 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:55.384597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983757aa-c3fa-42d4-a9ee-93af5245fa58 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:55.384694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983757aa-c3fa-42d4-a9ee-93af5245fa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:55.401743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-983757aa-c3fa-42d4-a9ee-93af5245fa58 None None] MFA Rules not processed for user `d099a8ecc77b4259aa30f227ae8f28ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:50:55.402967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-983757aa-c3fa-42d4-a9ee-93af5245fa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:55.459980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1266/2530] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:50:55.750753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:50:55.752261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:55.808395 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd6aa2-1c19-4ad3-8321-cd8759fa37fc service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:50:55.812006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:50:55.812646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:50:55.812946 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:50:55.813200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:50:55.814987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:50:55.824262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:50:55.825680 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:50:55.834232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1265/2531] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:50:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:51:15.141993 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b97e-4b3e-44da-89c2-c730d4bd286b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:15.142542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b97e-4b3e-44da-89c2-c730d4bd286b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:15.142653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b97e-4b3e-44da-89c2-c730d4bd286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:15.160971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c832b97e-4b3e-44da-89c2-c730d4bd286b None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:51:15.162171 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c832b97e-4b3e-44da-89c2-c730d4bd286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:15.213522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1267/2532] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:51:15.258874 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:15.260261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:15.335677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9edcd0-314b-482c-8b0b-f8b5b526616e service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:15.340566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20e6fb-e852-43b5-8a65-8fd2a65028dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:15.341207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20e6fb-e852-43b5-8a65-8fd2a65028dd service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:15.341490 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20e6fb-e852-43b5-8a65-8fd2a65028dd service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:15.341765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20e6fb-e852-43b5-8a65-8fd2a65028dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:15.350303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20e6fb-e852-43b5-8a65-8fd2a65028dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:15.351884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20e6fb-e852-43b5-8a65-8fd2a65028dd service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:15.359888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1266/2533] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:51:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:51:24.027687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832b97e-4b3e-44da-89c2-c730d4bd286b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:24.029300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c832b97e-4b3e-44da-89c2-c730d4bd286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:24.051411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832b97e-4b3e-44da-89c2-c730d4bd286b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:24.056323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1640-fb94-4a4e-b86a-c45c6ca3e0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:24.056984 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1640-fb94-4a4e-b86a-c45c6ca3e0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:24.057283 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1640-fb94-4a4e-b86a-c45c6ca3e0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:24.057557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1640-fb94-4a4e-b86a-c45c6ca3e0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:24.059610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a25a1640-fb94-4a4e-b86a-c45c6ca3e0b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:24.130929 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1640-fb94-4a4e-b86a-c45c6ca3e0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:24.132471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1640-fb94-4a4e-b86a-c45c6ca3e0b3 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:24.154995 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1268/2534] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:51:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:51:31.621853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20e6fb-e852-43b5-8a65-8fd2a65028dd service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:31.632685 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20e6fb-e852-43b5-8a65-8fd2a65028dd service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:31.637113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02324d5e-3948-4798-81b5-1013be76e1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:31.637748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02324d5e-3948-4798-81b5-1013be76e1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:31.638057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02324d5e-3948-4798-81b5-1013be76e1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:31.638332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02324d5e-3948-4798-81b5-1013be76e1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:31.640072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-02324d5e-3948-4798-81b5-1013be76e1d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:31.703035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02324d5e-3948-4798-81b5-1013be76e1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:31.704531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02324d5e-3948-4798-81b5-1013be76e1d6 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:31.714951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1267/2535] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:51:32.500704 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b15ec-e6f1-46aa-9b73-1c425ec9857d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:32.501271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b15ec-e6f1-46aa-9b73-1c425ec9857d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:32.501271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b15ec-e6f1-46aa-9b73-1c425ec9857d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:32.503288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1269/2536] 10.222.0.75 () {54 vars in 921 bytes} [Tue May 17 15:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 15:51:32.511754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424762c5-f8e9-4327-995a-13185b9d27a0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:32.511977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424762c5-f8e9-4327-995a-13185b9d27a0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:32.512255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424762c5-f8e9-4327-995a-13185b9d27a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:32.530641 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-424762c5-f8e9-4327-995a-13185b9d27a0 None None] MFA Rules not processed for user `8ef90c1c9c784d8792b3afe6e8e7fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:51:32.532102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-424762c5-f8e9-4327-995a-13185b9d27a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:32.608742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1268/2537] 10.222.0.75 () {58 vars in 1018 bytes} [Tue May 17 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:51:32.624026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b15ec-e6f1-46aa-9b73-1c425ec9857d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:32.625801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-088b15ec-e6f1-46aa-9b73-1c425ec9857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:32.701945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b15ec-e6f1-46aa-9b73-1c425ec9857d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:32.705983 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196ec04-8d88-405c-b6ae-58da0595ef4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22c0e889e1f842b2a6081f38aabd97ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:32.706761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196ec04-8d88-405c-b6ae-58da0595ef4c service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:32.707046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196ec04-8d88-405c-b6ae-58da0595ef4c service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:32.707428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196ec04-8d88-405c-b6ae-58da0595ef4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:32.718878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196ec04-8d88-405c-b6ae-58da0595ef4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:32.720358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196ec04-8d88-405c-b6ae-58da0595ef4c service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:32.732781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1270/2538] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:51:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:51:35.116005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557c735-c511-487e-be6c-727b1ff3bbf5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:35.116483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557c735-c511-487e-be6c-727b1ff3bbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:35.116672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557c735-c511-487e-be6c-727b1ff3bbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:35.137617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6557c735-c511-487e-be6c-727b1ff3bbf5 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:51:35.139424 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6557c735-c511-487e-be6c-727b1ff3bbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:35.148151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1269/2539] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:51:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:51:35.164054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196ec04-8d88-405c-b6ae-58da0595ef4c service glance] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:35.177421 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196ec04-8d88-405c-b6ae-58da0595ef4c service glance] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:35.183432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1fd51-f03c-41a3-8d1c-e133fac6abd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:35.184068 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1fd51-f03c-41a3-8d1c-e133fac6abd3 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:35.184348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1fd51-f03c-41a3-8d1c-e133fac6abd3 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:35.184618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1fd51-f03c-41a3-8d1c-e133fac6abd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:35.193761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1fd51-f03c-41a3-8d1c-e133fac6abd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:35.195624 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1fd51-f03c-41a3-8d1c-e133fac6abd3 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:35.210476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1271/2540] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:51:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:51:39.394100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557c735-c511-487e-be6c-727b1ff3bbf5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:39.396414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6557c735-c511-487e-be6c-727b1ff3bbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:39.425504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557c735-c511-487e-be6c-727b1ff3bbf5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:39.430128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:39.431011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:39.431294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:39.431604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] PATH_INFO: `/v3/users/7b0e466b56814e10a27304db1bb7b262` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:39.432843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0e466b56814e10a27304db1bb7b262)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:39.435008 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:39.487585 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0e466b56814e10a27304db1bb7b262'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.499763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0e466b56814e10a27304db1bb7b262'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.500860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0e466b56814e10a27304db1bb7b262'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.501951 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0e466b56814e10a27304db1bb7b262'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.509655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0e466b56814e10a27304db1bb7b262'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.524778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1270/2541] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:51:39 2022] DELETE /identity/v3/users/7b0e466b56814e10a27304db1bb7b262 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:51:39.714096 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1fd51-f03c-41a3-8d1c-e133fac6abd3 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:39.726651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1fd51-f03c-41a3-8d1c-e133fac6abd3 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:39.787614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:39.788419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:39.788884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:39.789162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] PATH_INFO: `/v3/projects/4f8e659223ca4c2a8f4c6836e6a1cc18` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:39.790380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8e659223ca4c2a8f4c6836e6a1cc18)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:39.792273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:39.838484 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'request_id': 'req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.844976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'request_id': 'req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.854295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'request_id': 'req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.864648 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] The token cache is being invalidate because project 4f8e659223ca4c2a8f4c6836e6a1cc18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:51:39.864931 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.865548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:39.867108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1272/2542] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:51:39 2022] DELETE /identity/v3/projects/4f8e659223ca4c2a8f4c6836e6a1cc18 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:51:39.871139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:39.872591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:39.886826 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1524e3-3b08-48f4-a376-a8ff8c45c83f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:39.944504 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:39.945437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:39.945676 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:39.946020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] PATH_INFO: `/v3/users/82e4f8ae6ed3407980fb69efcd3fc463` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:39.947313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e4f8ae6ed3407980fb69efcd3fc463)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:39.949652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:39.999839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e4f8ae6ed3407980fb69efcd3fc463'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.012488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e4f8ae6ed3407980fb69efcd3fc463'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.013217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e4f8ae6ed3407980fb69efcd3fc463'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.013982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e4f8ae6ed3407980fb69efcd3fc463'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.021775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e4f8ae6ed3407980fb69efcd3fc463'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.038876 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1271/2543] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:51:39 2022] DELETE /identity/v3/users/82e4f8ae6ed3407980fb69efcd3fc463 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:51:40.226757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:40.228730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:40.247086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b3a3e-1177-4dfd-a3d5-c3d02e842aa5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:40.332041 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:40.333046 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:40.334318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:40.334631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] PATH_INFO: `/v3/projects/2880acf32f0e4e73a9996d9e2a5ada7d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:40.335893 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2880acf32f0e4e73a9996d9e2a5ada7d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:40.337815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:40.395863 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2880acf32f0e4e73a9996d9e2a5ada7d', 'request_id': 'req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.402710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2880acf32f0e4e73a9996d9e2a5ada7d', 'request_id': 'req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.412058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2880acf32f0e4e73a9996d9e2a5ada7d', 'request_id': 'req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.423989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] The token cache is being invalidate because project 2880acf32f0e4e73a9996d9e2a5ada7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:51:40.424282 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.425000 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9daa8b51-cd60-438d-9ed6-efe7116fc7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:51:40.426589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1273/2544] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:51:40 2022] DELETE /identity/v3/projects/2880acf32f0e4e73a9996d9e2a5ada7d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:51:54.404571 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:54.405896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:54.463503 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59e990-0e81-4efc-9ffe-f32d2ef37697 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:54.510073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:54.510713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:54.510993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:54.511265 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:54.513109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:54.578688 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:54.580124 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:54.591465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1272/2545] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:51:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:51:55.443599 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a642-a328-440f-8a18-a82024b5f46e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:55.444125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a642-a328-440f-8a18-a82024b5f46e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:55.444232 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a642-a328-440f-8a18-a82024b5f46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:55.461940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c324a642-a328-440f-8a18-a82024b5f46e None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:51:55.463184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c324a642-a328-440f-8a18-a82024b5f46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:55.514669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1274/2546] 10.222.0.75 () {58 vars in 967 bytes} [Tue May 17 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:51:55.527321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:51:55.528698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:51:55.592425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01eafe-778f-400b-af29-c628e4e9862a service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:51:55.597905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760f302-29e4-4f37-9c3e-653b6c5aadf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:51:55.598558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760f302-29e4-4f37-9c3e-653b6c5aadf8 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:51:55.598835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760f302-29e4-4f37-9c3e-653b6c5aadf8 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:51:55.599101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760f302-29e4-4f37-9c3e-653b6c5aadf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:51:55.607080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760f302-29e4-4f37-9c3e-653b6c5aadf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:51:55.608648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760f302-29e4-4f37-9c3e-653b6c5aadf8 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:51:55.616342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1273/2547] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:51:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:52:47.614054 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a642-a328-440f-8a18-a82024b5f46e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:52:47.615445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c324a642-a328-440f-8a18-a82024b5f46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:52:47.669500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a642-a328-440f-8a18-a82024b5f46e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:52:47.672948 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:52:47.673580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:52:47.673861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:52:47.674184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:52:47.675968 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:52:47.688793 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:52:47.690223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:52:47.701254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1275/2548] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:52:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:52:57.235873 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760f302-29e4-4f37-9c3e-653b6c5aadf8 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:52:57.237277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6760f302-29e4-4f37-9c3e-653b6c5aadf8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:52:57.249018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760f302-29e4-4f37-9c3e-653b6c5aadf8 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:52:57.252604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef371de-6a24-49ce-bebd-73408c38f807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:52:57.253231 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef371de-6a24-49ce-bebd-73408c38f807 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:52:57.253514 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef371de-6a24-49ce-bebd-73408c38f807 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:52:57.253903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef371de-6a24-49ce-bebd-73408c38f807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:52:57.255648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6ef371de-6a24-49ce-bebd-73408c38f807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:52:57.315288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef371de-6a24-49ce-bebd-73408c38f807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:52:57.316711 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef371de-6a24-49ce-bebd-73408c38f807 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:52:57.326904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1274/2549] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:53:00.442599 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:00.444198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:00.457655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3ac5-5735-45c7-8347-7f4dd7d4975b service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:00.462410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:00.463471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:00.463763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:00.464069 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] PATH_INFO: `/v3/users/d099a8ecc77b4259aa30f227ae8f28ad` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:00.479660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d099a8ecc77b4259aa30f227ae8f28ad)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:00.481592 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:00.524891 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd099a8ecc77b4259aa30f227ae8f28ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.536047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd099a8ecc77b4259aa30f227ae8f28ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.536692 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd099a8ecc77b4259aa30f227ae8f28ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.543675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd099a8ecc77b4259aa30f227ae8f28ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.551317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-60efa957-1ece-448c-8766-e0f98fa0838c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd099a8ecc77b4259aa30f227ae8f28ad'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.557060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1276/2550] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:00 2022] DELETE /identity/v3/users/d099a8ecc77b4259aa30f227ae8f28ad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:00.731947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef371de-6a24-49ce-bebd-73408c38f807 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:00.741911 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef371de-6a24-49ce-bebd-73408c38f807 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:00.798885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:00.799750 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:00.800126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:00.800401 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] PATH_INFO: `/v3/projects/b23dc4cf2a954ab8a64c81eac9080a70` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:00.810193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23dc4cf2a954ab8a64c81eac9080a70)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:00.812282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:00.864673 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23dc4cf2a954ab8a64c81eac9080a70', 'request_id': 'req-cd1a4b7d-9266-442e-b7ce-55619022be31'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.871185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23dc4cf2a954ab8a64c81eac9080a70', 'request_id': 'req-cd1a4b7d-9266-442e-b7ce-55619022be31'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.878839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23dc4cf2a954ab8a64c81eac9080a70', 'request_id': 'req-cd1a4b7d-9266-442e-b7ce-55619022be31'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.889214 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] The token cache is being invalidate because project b23dc4cf2a954ab8a64c81eac9080a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:00.889494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.890159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cd1a4b7d-9266-442e-b7ce-55619022be31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:00.891693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1275/2551] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:00 2022] DELETE /identity/v3/projects/b23dc4cf2a954ab8a64c81eac9080a70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:00.896684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29733a1b-9751-4ef3-b1bc-b725780ecffc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:00.896988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29733a1b-9751-4ef3-b1bc-b725780ecffc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:00.897325 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29733a1b-9751-4ef3-b1bc-b725780ecffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:00.916028 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-29733a1b-9751-4ef3-b1bc-b725780ecffc None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:00.917332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-29733a1b-9751-4ef3-b1bc-b725780ecffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:00.980688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1277/2552] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:53:00.988498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08319362-ee67-4cdc-9200-6c3670404c4d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:00.988783 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08319362-ee67-4cdc-9200-6c3670404c4d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:00.989078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08319362-ee67-4cdc-9200-6c3670404c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.007268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-08319362-ee67-4cdc-9200-6c3670404c4d None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:01.009001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-08319362-ee67-4cdc-9200-6c3670404c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:01.017316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1276/2553] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:01.021871 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29733a1b-9751-4ef3-b1bc-b725780ecffc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.034617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29733a1b-9751-4ef3-b1bc-b725780ecffc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.040532 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec554a-c587-4b26-8df1-34f9e7dbc88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.041191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec554a-c587-4b26-8df1-34f9e7dbc88b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.041475 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec554a-c587-4b26-8df1-34f9e7dbc88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.041752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec554a-c587-4b26-8df1-34f9e7dbc88b admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.042597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec554a-c587-4b26-8df1-34f9e7dbc88b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:53:01.042907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec554a-c587-4b26-8df1-34f9e7dbc88b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.044504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec554a-c587-4b26-8df1-34f9e7dbc88b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.061397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1278/2554] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:53:01.065749 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08319362-ee67-4cdc-9200-6c3670404c4d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.075409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08319362-ee67-4cdc-9200-6c3670404c4d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.080120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52049c4f-4d17-4809-a13b-4d9d937961a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.080763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52049c4f-4d17-4809-a13b-4d9d937961a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.081040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52049c4f-4d17-4809-a13b-4d9d937961a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.081321 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52049c4f-4d17-4809-a13b-4d9d937961a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.082025 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52049c4f-4d17-4809-a13b-4d9d937961a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.083936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52049c4f-4d17-4809-a13b-4d9d937961a0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.111393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1277/2555] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:01 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:01.115562 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec554a-c587-4b26-8df1-34f9e7dbc88b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.125318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec554a-c587-4b26-8df1-34f9e7dbc88b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.180039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54911f22-f760-40d3-8543-cf9b124d7b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.180649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54911f22-f760-40d3-8543-cf9b124d7b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.180949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54911f22-f760-40d3-8543-cf9b124d7b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.181223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54911f22-f760-40d3-8543-cf9b124d7b99 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.181953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54911f22-f760-40d3-8543-cf9b124d7b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.183972 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54911f22-f760-40d3-8543-cf9b124d7b99 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.202827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1279/2556] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:01 2022] POST /identity/v3/users => generated 279 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:01.206706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52049c4f-4d17-4809-a13b-4d9d937961a0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.217232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52049c4f-4d17-4809-a13b-4d9d937961a0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.221791 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d47f-b08d-450d-9ac3-a4f11779665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.222479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d47f-b08d-450d-9ac3-a4f11779665c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.222761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d47f-b08d-450d-9ac3-a4f11779665c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.223034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d47f-b08d-450d-9ac3-a4f11779665c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.223776 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2d47f-b08d-450d-9ac3-a4f11779665c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.225361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2d47f-b08d-450d-9ac3-a4f11779665c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.235348 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1278/2557] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:01.239180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54911f22-f760-40d3-8543-cf9b124d7b99 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.248928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54911f22-f760-40d3-8543-cf9b124d7b99 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.253476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2dacb-bd6e-42bd-885f-9e0520339442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.254155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2dacb-bd6e-42bd-885f-9e0520339442 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.254438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2dacb-bd6e-42bd-885f-9e0520339442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.254712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2dacb-bd6e-42bd-885f-9e0520339442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.255433 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2dacb-bd6e-42bd-885f-9e0520339442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.257009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2dacb-bd6e-42bd-885f-9e0520339442 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.267110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1280/2558] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:01.271114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d47f-b08d-450d-9ac3-a4f11779665c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.281414 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d47f-b08d-450d-9ac3-a4f11779665c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.286083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34380165-3785-4def-8ed3-d2ba6a31ad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.286982 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34380165-3785-4def-8ed3-d2ba6a31ad86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.287262 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34380165-3785-4def-8ed3-d2ba6a31ad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.287538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34380165-3785-4def-8ed3-d2ba6a31ad86 admin admin] PATH_INFO: `/v3/projects/a3ec45c5f37040198e82459dd158bb67/users/c2611bb515294aeba2cdafac501a4bcf/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.301346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34380165-3785-4def-8ed3-d2ba6a31ad86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ec45c5f37040198e82459dd158bb67, user_id=c2611bb515294aeba2cdafac501a4bcf, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.303999 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34380165-3785-4def-8ed3-d2ba6a31ad86 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.317463 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1279/2559] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:01 2022] PUT /identity/v3/projects/a3ec45c5f37040198e82459dd158bb67/users/c2611bb515294aeba2cdafac501a4bcf/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:01.327866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f410ab-5fe6-44c5-a7d4-33be1b96624b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.328155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f410ab-5fe6-44c5-a7d4-33be1b96624b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.328428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f410ab-5fe6-44c5-a7d4-33be1b96624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.354354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a4f410ab-5fe6-44c5-a7d4-33be1b96624b None None] MFA Rules not processed for user `c2611bb515294aeba2cdafac501a4bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:01.355551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a4f410ab-5fe6-44c5-a7d4-33be1b96624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:01.417410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1281/2560] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:01 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:01.421797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34380165-3785-4def-8ed3-d2ba6a31ad86 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.480013 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34380165-3785-4def-8ed3-d2ba6a31ad86 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.484560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449074c5-2bb5-40dd-9150-7333cd9d4ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.485233 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449074c5-2bb5-40dd-9150-7333cd9d4ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.485521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449074c5-2bb5-40dd-9150-7333cd9d4ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.485795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449074c5-2bb5-40dd-9150-7333cd9d4ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.486496 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449074c5-2bb5-40dd-9150-7333cd9d4ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.488386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449074c5-2bb5-40dd-9150-7333cd9d4ce2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.513465 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1280/2561] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:01 2022] POST /identity/v3/projects => generated 357 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:01.517593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f410ab-5fe6-44c5-a7d4-33be1b96624b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.528288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f410ab-5fe6-44c5-a7d4-33be1b96624b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.581553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74315f0f-a307-44d8-b213-b53e0884ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.582242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74315f0f-a307-44d8-b213-b53e0884ae45 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.582525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74315f0f-a307-44d8-b213-b53e0884ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.582797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74315f0f-a307-44d8-b213-b53e0884ae45 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.583470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74315f0f-a307-44d8-b213-b53e0884ae45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.585360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74315f0f-a307-44d8-b213-b53e0884ae45 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.604759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1282/2562] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:01 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:53:01.608640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449074c5-2bb5-40dd-9150-7333cd9d4ce2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.619361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449074c5-2bb5-40dd-9150-7333cd9d4ce2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.623945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e934a-1197-4c9f-bfe4-87ac7ef0e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.624588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e934a-1197-4c9f-bfe4-87ac7ef0e4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.624999 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e934a-1197-4c9f-bfe4-87ac7ef0e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.625277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e934a-1197-4c9f-bfe4-87ac7ef0e4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.626020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e934a-1197-4c9f-bfe4-87ac7ef0e4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.627597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e934a-1197-4c9f-bfe4-87ac7ef0e4d4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.638454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1281/2563] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:01.642413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74315f0f-a307-44d8-b213-b53e0884ae45 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.652160 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74315f0f-a307-44d8-b213-b53e0884ae45 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.656732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3652d-b086-40eb-8d31-193df341b7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.657650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3652d-b086-40eb-8d31-193df341b7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.657926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3652d-b086-40eb-8d31-193df341b7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.658232 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3652d-b086-40eb-8d31-193df341b7d5 admin admin] PATH_INFO: `/v3/projects/1fa5500cfeca4969a8fdc9c3ef163953/users/a6bd4a07996548e4a91833a93c40fbd3/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.672676 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3652d-b086-40eb-8d31-193df341b7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa5500cfeca4969a8fdc9c3ef163953, user_id=a6bd4a07996548e4a91833a93c40fbd3, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.675337 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3652d-b086-40eb-8d31-193df341b7d5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.689496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1283/2564] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:01 2022] PUT /identity/v3/projects/1fa5500cfeca4969a8fdc9c3ef163953/users/a6bd4a07996548e4a91833a93c40fbd3/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:01.693594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e934a-1197-4c9f-bfe4-87ac7ef0e4d4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.704069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e934a-1197-4c9f-bfe4-87ac7ef0e4d4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.753493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3652d-b086-40eb-8d31-193df341b7d5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.755205 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-43e3652d-b086-40eb-8d31-193df341b7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:01.761722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cfee3-76a4-49aa-a974-6119522f2028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.762508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cfee3-76a4-49aa-a974-6119522f2028 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.762821 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cfee3-76a4-49aa-a974-6119522f2028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.763124 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cfee3-76a4-49aa-a974-6119522f2028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.763995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cfee3-76a4-49aa-a974-6119522f2028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.765656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cfee3-76a4-49aa-a974-6119522f2028 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.779319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1282/2565] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:53:01.780586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cfee3-76a4-49aa-a974-6119522f2028 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.794409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cfee3-76a4-49aa-a974-6119522f2028 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.799216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3002e-fa23-4bd8-9652-63746c24f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.800081 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3002e-fa23-4bd8-9652-63746c24f0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.800434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3002e-fa23-4bd8-9652-63746c24f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.800636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3002e-fa23-4bd8-9652-63746c24f0cc admin admin] PATH_INFO: `/v3/projects/1fa5500cfeca4969a8fdc9c3ef163953/users/a6bd4a07996548e4a91833a93c40fbd3/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.803679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3002e-fa23-4bd8-9652-63746c24f0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa5500cfeca4969a8fdc9c3ef163953, user_id=a6bd4a07996548e4a91833a93c40fbd3, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.806949 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3002e-fa23-4bd8-9652-63746c24f0cc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.814946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3652d-b086-40eb-8d31-193df341b7d5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.818445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1283/2566] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:01 2022] PUT /identity/v3/projects/1fa5500cfeca4969a8fdc9c3ef163953/users/a6bd4a07996548e4a91833a93c40fbd3/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:53:01.830113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f0b11-9af5-49fa-8f94-bed6e76cc2d2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.830415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f0b11-9af5-49fa-8f94-bed6e76cc2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.830677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f0b11-9af5-49fa-8f94-bed6e76cc2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.859323 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ba0f0b11-9af5-49fa-8f94-bed6e76cc2d2 None None] MFA Rules not processed for user `a6bd4a07996548e4a91833a93c40fbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:01.860670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ba0f0b11-9af5-49fa-8f94-bed6e76cc2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:01.867077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da4b88-0c95-4588-b03f-db4404570166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.868359 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4b88-0c95-4588-b03f-db4404570166 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.868645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4b88-0c95-4588-b03f-db4404570166 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.868922 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4b88-0c95-4588-b03f-db4404570166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.870774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-70da4b88-0c95-4588-b03f-db4404570166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:01.926327 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1284/2567] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:01 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:53:01.938328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f0b11-9af5-49fa-8f94-bed6e76cc2d2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:01.939768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ba0f0b11-9af5-49fa-8f94-bed6e76cc2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:01.951647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f0b11-9af5-49fa-8f94-bed6e76cc2d2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:01.955415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609b6f7-833f-4176-983f-28e36dc53bab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:01.956469 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609b6f7-833f-4176-983f-28e36dc53bab service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:01.956632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da4b88-0c95-4588-b03f-db4404570166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.956953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609b6f7-833f-4176-983f-28e36dc53bab service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:01.957339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609b6f7-833f-4176-983f-28e36dc53bab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:01.958188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da4b88-0c95-4588-b03f-db4404570166 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.966970 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609b6f7-833f-4176-983f-28e36dc53bab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:01.968409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609b6f7-833f-4176-983f-28e36dc53bab service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:01.976355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1284/2568] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:53:01.980320 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1285/2569] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:01 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:53:02.054488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da4b88-0c95-4588-b03f-db4404570166 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:02.063311 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da4b88-0c95-4588-b03f-db4404570166 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:02.066684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe453bee-af51-479c-b5cd-19390d876bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:02.067320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe453bee-af51-479c-b5cd-19390d876bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:02.067601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe453bee-af51-479c-b5cd-19390d876bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:02.067903 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe453bee-af51-479c-b5cd-19390d876bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:02.124956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe453bee-af51-479c-b5cd-19390d876bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:02.126422 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe453bee-af51-479c-b5cd-19390d876bb8 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:02.136845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1285/2570] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:02 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:08.868232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609b6f7-833f-4176-983f-28e36dc53bab service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:08.869761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8609b6f7-833f-4176-983f-28e36dc53bab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:08.936094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609b6f7-833f-4176-983f-28e36dc53bab service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:08.941095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e35581-16ef-47ed-9842-e8aee1ec6454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:08.941667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e35581-16ef-47ed-9842-e8aee1ec6454 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:08.941950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e35581-16ef-47ed-9842-e8aee1ec6454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:08.942412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e35581-16ef-47ed-9842-e8aee1ec6454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:08.944801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a1e35581-16ef-47ed-9842-e8aee1ec6454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:09.006948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e35581-16ef-47ed-9842-e8aee1ec6454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:09.008383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e35581-16ef-47ed-9842-e8aee1ec6454 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:09.018601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1286/2571] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:12.061292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe453bee-af51-479c-b5cd-19390d876bb8 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:12.062876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fe453bee-af51-479c-b5cd-19390d876bb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:12.079466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe453bee-af51-479c-b5cd-19390d876bb8 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:12.084180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:12.085052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.085339 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.085617 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] PATH_INFO: `/v3/users/2e4972b781b043f69740342fde4efa73` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.087393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4972b781b043f69740342fde4efa73)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:12.089316 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:12.147269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4972b781b043f69740342fde4efa73'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.162206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4972b781b043f69740342fde4efa73'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.162910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4972b781b043f69740342fde4efa73'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.169770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4972b781b043f69740342fde4efa73'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.177440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-22d3b795-8641-4897-a9ca-72c936ad1509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4972b781b043f69740342fde4efa73'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.183336 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1286/2572] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:12 2022] DELETE /identity/v3/users/2e4972b781b043f69740342fde4efa73 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:12.360515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e35581-16ef-47ed-9842-e8aee1ec6454 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:12.371098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e35581-16ef-47ed-9842-e8aee1ec6454 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:12.427107 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:12.427966 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.428248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.428525 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] PATH_INFO: `/v3/projects/bf36f753be81486182665056a949849c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.429828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf36f753be81486182665056a949849c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:12.431752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:12.476018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf36f753be81486182665056a949849c', 'request_id': 'req-b66799b1-11c9-47d6-b66a-c12f6a22049c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.482557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf36f753be81486182665056a949849c', 'request_id': 'req-b66799b1-11c9-47d6-b66a-c12f6a22049c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.489697 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf36f753be81486182665056a949849c', 'request_id': 'req-b66799b1-11c9-47d6-b66a-c12f6a22049c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.500086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] The token cache is being invalidate because project bf36f753be81486182665056a949849c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:12.500365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.500985 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b66799b1-11c9-47d6-b66a-c12f6a22049c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:12.502543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1287/2573] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:12 2022] DELETE /identity/v3/projects/bf36f753be81486182665056a949849c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:12.507499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1d624-9f77-44cb-a9c6-25fadec83b30 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.507737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1d624-9f77-44cb-a9c6-25fadec83b30 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.508013 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1d624-9f77-44cb-a9c6-25fadec83b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.525685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-39c1d624-9f77-44cb-a9c6-25fadec83b30 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:12.526988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-39c1d624-9f77-44cb-a9c6-25fadec83b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:12.582835 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1287/2574] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:12.591359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986144c-2773-4514-8a4c-ff4005553a4a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.591647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986144c-2773-4514-8a4c-ff4005553a4a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.591927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986144c-2773-4514-8a4c-ff4005553a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.610328 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3986144c-2773-4514-8a4c-ff4005553a4a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:12.611517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3986144c-2773-4514-8a4c-ff4005553a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:12.619208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1288/2575] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:12.623182 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1d624-9f77-44cb-a9c6-25fadec83b30 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:12.632434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1d624-9f77-44cb-a9c6-25fadec83b30 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:12.636882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1e31-cb77-456b-b864-3c66088fd289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:12.637519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1e31-cb77-456b-b864-3c66088fd289 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.637798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1e31-cb77-456b-b864-3c66088fd289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.638108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1e31-cb77-456b-b864-3c66088fd289 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.638823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1e31-cb77-456b-b864-3c66088fd289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:53:12.639126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1e31-cb77-456b-b864-3c66088fd289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:12.640711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1e31-cb77-456b-b864-3c66088fd289 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:12.652184 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1288/2576] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:53:12.656200 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986144c-2773-4514-8a4c-ff4005553a4a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:12.665752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986144c-2773-4514-8a4c-ff4005553a4a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:12.670508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028058d-b7f7-4a89-a061-dfaa5dd1d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:12.671146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028058d-b7f7-4a89-a061-dfaa5dd1d8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.671428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028058d-b7f7-4a89-a061-dfaa5dd1d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.671737 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028058d-b7f7-4a89-a061-dfaa5dd1d8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.672422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028058d-b7f7-4a89-a061-dfaa5dd1d8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:12.674353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028058d-b7f7-4a89-a061-dfaa5dd1d8a7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:12.698674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1289/2577] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:12 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:12.702681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1e31-cb77-456b-b864-3c66088fd289 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:12.712928 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1e31-cb77-456b-b864-3c66088fd289 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:12.768392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948974b7-cde0-4d48-a74a-57391cc29afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:12.768982 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948974b7-cde0-4d48-a74a-57391cc29afc admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.769264 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948974b7-cde0-4d48-a74a-57391cc29afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.769543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948974b7-cde0-4d48-a74a-57391cc29afc admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.770262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948974b7-cde0-4d48-a74a-57391cc29afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:12.772164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948974b7-cde0-4d48-a74a-57391cc29afc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:12.795912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1289/2578] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:12 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:53:12.797018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028058d-b7f7-4a89-a061-dfaa5dd1d8a7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:12.807383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028058d-b7f7-4a89-a061-dfaa5dd1d8a7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:12.814435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27430f3c-6e02-4d3d-bb07-48c3e7b16e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:12.815122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27430f3c-6e02-4d3d-bb07-48c3e7b16e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.815407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27430f3c-6e02-4d3d-bb07-48c3e7b16e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.815701 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27430f3c-6e02-4d3d-bb07-48c3e7b16e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.816435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27430f3c-6e02-4d3d-bb07-48c3e7b16e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:12.818072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27430f3c-6e02-4d3d-bb07-48c3e7b16e0d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:12.831652 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1290/2579] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:12.833215 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948974b7-cde0-4d48-a74a-57391cc29afc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:12.843815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948974b7-cde0-4d48-a74a-57391cc29afc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:12.849089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed98839-8b7a-450d-99d7-1074d057e9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:12.849712 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed98839-8b7a-450d-99d7-1074d057e9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.850079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed98839-8b7a-450d-99d7-1074d057e9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.850308 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed98839-8b7a-450d-99d7-1074d057e9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.851044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed98839-8b7a-450d-99d7-1074d057e9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:12.853482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed98839-8b7a-450d-99d7-1074d057e9aa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:12.865814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1290/2580] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:53:12.869928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27430f3c-6e02-4d3d-bb07-48c3e7b16e0d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:12.881517 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27430f3c-6e02-4d3d-bb07-48c3e7b16e0d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:12.887488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5adbb-b107-459c-bb41-d8dadec19e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:12.888225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5adbb-b107-459c-bb41-d8dadec19e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.888519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5adbb-b107-459c-bb41-d8dadec19e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.888795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5adbb-b107-459c-bb41-d8dadec19e1f admin admin] PATH_INFO: `/v3/projects/fabeead7b416455b8d93f9531f895ba4/users/5a87409628484aa189c7dd44ee74344d/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.905381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5adbb-b107-459c-bb41-d8dadec19e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabeead7b416455b8d93f9531f895ba4, user_id=5a87409628484aa189c7dd44ee74344d, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:12.908397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5adbb-b107-459c-bb41-d8dadec19e1f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:12.924243 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1291/2581] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:12 2022] PUT /identity/v3/projects/fabeead7b416455b8d93f9531f895ba4/users/5a87409628484aa189c7dd44ee74344d/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:53:12.929872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87732423-89df-4907-918f-c7d81f44765a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:12.930292 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87732423-89df-4907-918f-c7d81f44765a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:12.930664 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87732423-89df-4907-918f-c7d81f44765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:12.949867 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-87732423-89df-4907-918f-c7d81f44765a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:12.951202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-87732423-89df-4907-918f-c7d81f44765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:13.008127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1291/2582] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:53:13.018255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5adbb-b107-459c-bb41-d8dadec19e1f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:13.019992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-99a5adbb-b107-459c-bb41-d8dadec19e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:13.074103 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5adbb-b107-459c-bb41-d8dadec19e1f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:13.077694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecbc5a-897a-4aac-87f7-22447aeeaa83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:13.078362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecbc5a-897a-4aac-87f7-22447aeeaa83 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:13.078638 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecbc5a-897a-4aac-87f7-22447aeeaa83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:13.078907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecbc5a-897a-4aac-87f7-22447aeeaa83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:13.088095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecbc5a-897a-4aac-87f7-22447aeeaa83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:13.089506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecbc5a-897a-4aac-87f7-22447aeeaa83 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:13.098625 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1292/2583] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:17.095323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e806c2-58e5-4fb4-9746-49d6dffe4b5a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:17.095898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e806c2-58e5-4fb4-9746-49d6dffe4b5a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:17.095898 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e806c2-58e5-4fb4-9746-49d6dffe4b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:17.125214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-12e806c2-58e5-4fb4-9746-49d6dffe4b5a None None] MFA Rules not processed for user `5a87409628484aa189c7dd44ee74344d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:17.126753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-12e806c2-58e5-4fb4-9746-49d6dffe4b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:17.195657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecbc5a-897a-4aac-87f7-22447aeeaa83 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:17.198196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-69ecbc5a-897a-4aac-87f7-22447aeeaa83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:17.210279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1292/2584] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:17.217295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecbc5a-897a-4aac-87f7-22447aeeaa83 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:17.222602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:17.224489 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:17.224775 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:17.225087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] PATH_INFO: `/v3/users/c2611bb515294aeba2cdafac501a4bcf` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:17.225373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e806c2-58e5-4fb4-9746-49d6dffe4b5a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:17.226421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2611bb515294aeba2cdafac501a4bcf)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:17.226950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-12e806c2-58e5-4fb4-9746-49d6dffe4b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:17.228636 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:17.281726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2611bb515294aeba2cdafac501a4bcf'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:17.294747 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2611bb515294aeba2cdafac501a4bcf'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:17.295482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2611bb515294aeba2cdafac501a4bcf'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:17.296088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2611bb515294aeba2cdafac501a4bcf'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:17.303853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ee1e674c-759a-4245-a191-9c18c587c745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2611bb515294aeba2cdafac501a4bcf'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:17.316967 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e806c2-58e5-4fb4-9746-49d6dffe4b5a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:17.318923 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1293/2585] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:17 2022] DELETE /identity/v3/users/c2611bb515294aeba2cdafac501a4bcf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:53:17.323977 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555a94-9e3c-4e90-9259-93ab5a8e16d9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:17.324272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555a94-9e3c-4e90-9259-93ab5a8e16d9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:17.324505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555a94-9e3c-4e90-9259-93ab5a8e16d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:17.342397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-67555a94-9e3c-4e90-9259-93ab5a8e16d9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:17.343519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-67555a94-9e3c-4e90-9259-93ab5a8e16d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:17.392444 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:17.393277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:17.393855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:17.394525 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:17.398079 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:17.412155 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1294/2586] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:17.422034 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555a94-9e3c-4e90-9259-93ab5a8e16d9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:17.423415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-67555a94-9e3c-4e90-9259-93ab5a8e16d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:17.484288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:17.485952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:17.507889 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1293/2587] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:53:17.515100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555a94-9e3c-4e90-9259-93ab5a8e16d9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:17.519442 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb2dd4-2b61-42a9-8eb3-80ee644f9ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:17.519988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb2dd4-2b61-42a9-8eb3-80ee644f9ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:17.520269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb2dd4-2b61-42a9-8eb3-80ee644f9ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:17.520539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb2dd4-2b61-42a9-8eb3-80ee644f9ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:17.530774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb2dd4-2b61-42a9-8eb3-80ee644f9ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:17.532286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb2dd4-2b61-42a9-8eb3-80ee644f9ea9 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:17.543844 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1295/2588] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:53:17.874720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:17.876549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:17.895566 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22efe23-1798-4f47-853a-a37f9ef287fc service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:17.903646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:17.905397 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:17.905846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:17.906232 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] PATH_INFO: `/v3/projects/a3ec45c5f37040198e82459dd158bb67` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:17.916523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ec45c5f37040198e82459dd158bb67)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:17.921443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:17.985970 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ec45c5f37040198e82459dd158bb67', 'request_id': 'req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:17.993584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ec45c5f37040198e82459dd158bb67', 'request_id': 'req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.002727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ec45c5f37040198e82459dd158bb67', 'request_id': 'req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.015872 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] The token cache is being invalidate because project a3ec45c5f37040198e82459dd158bb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:18.016255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.016795 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.018781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1294/2589] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:17 2022] DELETE /identity/v3/projects/a3ec45c5f37040198e82459dd158bb67 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:18.022744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb2dd4-2b61-42a9-8eb3-80ee644f9ea9 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:18.033271 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb2dd4-2b61-42a9-8eb3-80ee644f9ea9 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:18.094829 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:18.095579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:18.095852 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:18.096117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] PATH_INFO: `/v3/users/a6bd4a07996548e4a91833a93c40fbd3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:18.097295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bd4a07996548e4a91833a93c40fbd3)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:18.099247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:18.159592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bd4a07996548e4a91833a93c40fbd3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.171308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bd4a07996548e4a91833a93c40fbd3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.172029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bd4a07996548e4a91833a93c40fbd3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.172658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bd4a07996548e4a91833a93c40fbd3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.179548 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-967b4f0d-55de-4b21-99e3-b9aae1d63f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bd4a07996548e4a91833a93c40fbd3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.193198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1296/2590] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:18 2022] DELETE /identity/v3/users/a6bd4a07996548e4a91833a93c40fbd3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:18.596895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:18.598614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:18.614036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc456f-4776-4727-abb7-ae7ad0fc97f4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:18.680672 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:18.681548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:18.681884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:18.682189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] PATH_INFO: `/v3/projects/1fa5500cfeca4969a8fdc9c3ef163953` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:18.683541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa5500cfeca4969a8fdc9c3ef163953)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:18.685467 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:18.741102 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa5500cfeca4969a8fdc9c3ef163953', 'request_id': 'req-09374eef-71c7-4a86-87f6-4734c53fa4cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.748071 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa5500cfeca4969a8fdc9c3ef163953', 'request_id': 'req-09374eef-71c7-4a86-87f6-4734c53fa4cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.755689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa5500cfeca4969a8fdc9c3ef163953', 'request_id': 'req-09374eef-71c7-4a86-87f6-4734c53fa4cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.767340 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] The token cache is being invalidate because project 1fa5500cfeca4969a8fdc9c3ef163953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:18.767629 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.768286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-09374eef-71c7-4a86-87f6-4734c53fa4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:18.769801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1295/2591] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:18 2022] DELETE /identity/v3/projects/1fa5500cfeca4969a8fdc9c3ef163953 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:53:18.775758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6435d-42aa-4b92-bb50-edcfc598c7f9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:18.776216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6435d-42aa-4b92-bb50-edcfc598c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:18.776391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6435d-42aa-4b92-bb50-edcfc598c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:18.793726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-20b6435d-42aa-4b92-bb50-edcfc598c7f9 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:18.794992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-20b6435d-42aa-4b92-bb50-edcfc598c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:18.857344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1297/2592] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:18.865593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7afd-c77f-4f04-b4e6-d4c28ebcc7be None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:18.865593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7afd-c77f-4f04-b4e6-d4c28ebcc7be None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:18.865593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7afd-c77f-4f04-b4e6-d4c28ebcc7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:18.899781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-983e7afd-c77f-4f04-b4e6-d4c28ebcc7be None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:18.900586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-983e7afd-c77f-4f04-b4e6-d4c28ebcc7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:18.917191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1296/2593] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:18.918255 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6435d-42aa-4b92-bb50-edcfc598c7f9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:18.935273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6435d-42aa-4b92-bb50-edcfc598c7f9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:18.941376 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31080d6-8a7f-4fc6-86f1-06d7b7c247f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:18.942392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31080d6-8a7f-4fc6-86f1-06d7b7c247f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:18.942872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31080d6-8a7f-4fc6-86f1-06d7b7c247f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:18.943344 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31080d6-8a7f-4fc6-86f1-06d7b7c247f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:18.944266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31080d6-8a7f-4fc6-86f1-06d7b7c247f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:53:18.944757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31080d6-8a7f-4fc6-86f1-06d7b7c247f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:18.947247 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31080d6-8a7f-4fc6-86f1-06d7b7c247f2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:18.961940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1298/2594] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:53:18.966315 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7afd-c77f-4f04-b4e6-d4c28ebcc7be None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:18.977178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7afd-c77f-4f04-b4e6-d4c28ebcc7be None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:18.984978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bb496-3c85-4618-a97e-eb357408ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:18.985754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb496-3c85-4618-a97e-eb357408ef5b admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:18.986171 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb496-3c85-4618-a97e-eb357408ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:18.986550 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb496-3c85-4618-a97e-eb357408ef5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:18.987211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bb496-3c85-4618-a97e-eb357408ef5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:18.989162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bb496-3c85-4618-a97e-eb357408ef5b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.005276 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a5bcf-8e6d-48e3-81f5-306831697360 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.006056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a5bcf-8e6d-48e3-81f5-306831697360 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.006516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a5bcf-8e6d-48e3-81f5-306831697360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.022989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1297/2595] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:18 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:53:19.024127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bb496-3c85-4618-a97e-eb357408ef5b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.027613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c32a5bcf-8e6d-48e3-81f5-306831697360 None None] MFA Rules not processed for user `5a87409628484aa189c7dd44ee74344d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:19.029087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c32a5bcf-8e6d-48e3-81f5-306831697360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:19.087155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bb496-3c85-4618-a97e-eb357408ef5b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.087899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1299/2596] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:19.094449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8539b7-54a0-4c39-9e7d-5635b10c5349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.095138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8539b7-54a0-4c39-9e7d-5635b10c5349 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.095423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8539b7-54a0-4c39-9e7d-5635b10c5349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.095700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8539b7-54a0-4c39-9e7d-5635b10c5349 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.096395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8539b7-54a0-4c39-9e7d-5635b10c5349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.098763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8539b7-54a0-4c39-9e7d-5635b10c5349 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.122037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1298/2597] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:19 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:19.126576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a5bcf-8e6d-48e3-81f5-306831697360 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.139379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a5bcf-8e6d-48e3-81f5-306831697360 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.144675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dd215-2a78-4838-a860-cde3c16efd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.145450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dd215-2a78-4838-a860-cde3c16efd0f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.145848 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dd215-2a78-4838-a860-cde3c16efd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.146234 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dd215-2a78-4838-a860-cde3c16efd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.147071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dd215-2a78-4838-a860-cde3c16efd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.148968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dd215-2a78-4838-a860-cde3c16efd0f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.162730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1300/2598] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:19.168763 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8539b7-54a0-4c39-9e7d-5635b10c5349 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.179827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8539b7-54a0-4c39-9e7d-5635b10c5349 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.185728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53935b6b-c03f-48f0-b0e0-8810c1e4a3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.186702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53935b6b-c03f-48f0-b0e0-8810c1e4a3bd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.187014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53935b6b-c03f-48f0-b0e0-8810c1e4a3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.187565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53935b6b-c03f-48f0-b0e0-8810c1e4a3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.188319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53935b6b-c03f-48f0-b0e0-8810c1e4a3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.189966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53935b6b-c03f-48f0-b0e0-8810c1e4a3bd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.201888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1299/2599] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:19.206100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dd215-2a78-4838-a860-cde3c16efd0f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.216235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dd215-2a78-4838-a860-cde3c16efd0f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.221383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eae98b-7827-4082-b15e-200056bdc368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.222334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eae98b-7827-4082-b15e-200056bdc368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.222623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eae98b-7827-4082-b15e-200056bdc368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.222900 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eae98b-7827-4082-b15e-200056bdc368 admin admin] PATH_INFO: `/v3/projects/0c84b0e76bc24cae837dfa39d558f4ab/users/db652ae2fd9542aa89c3c187ffebb95d/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.242398 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eae98b-7827-4082-b15e-200056bdc368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c84b0e76bc24cae837dfa39d558f4ab, user_id=db652ae2fd9542aa89c3c187ffebb95d, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.245574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eae98b-7827-4082-b15e-200056bdc368 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.260563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1301/2600] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:19 2022] PUT /identity/v3/projects/0c84b0e76bc24cae837dfa39d558f4ab/users/db652ae2fd9542aa89c3c187ffebb95d/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:19.271993 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca3ff-8089-4753-8a94-32606d7344c7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.272567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca3ff-8089-4753-8a94-32606d7344c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.272943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca3ff-8089-4753-8a94-32606d7344c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.303240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b69ca3ff-8089-4753-8a94-32606d7344c7 None None] MFA Rules not processed for user `db652ae2fd9542aa89c3c187ffebb95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:19.304450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b69ca3ff-8089-4753-8a94-32606d7344c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:19.377462 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1300/2601] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:19.381694 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eae98b-7827-4082-b15e-200056bdc368 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.461939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eae98b-7827-4082-b15e-200056bdc368 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.467128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30be0b-a370-4515-b029-402ab240ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.467890 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30be0b-a370-4515-b029-402ab240ea72 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.468174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30be0b-a370-4515-b029-402ab240ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.468520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30be0b-a370-4515-b029-402ab240ea72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.469232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30be0b-a370-4515-b029-402ab240ea72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.471883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30be0b-a370-4515-b029-402ab240ea72 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.507102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1302/2602] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:19 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:19.508663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ca3ff-8089-4753-8a94-32606d7344c7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.521791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ca3ff-8089-4753-8a94-32606d7344c7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.595335 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c28154-0e0d-47ba-99ba-65feda4ae7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.596015 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c28154-0e0d-47ba-99ba-65feda4ae7ba admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.596297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c28154-0e0d-47ba-99ba-65feda4ae7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.596572 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c28154-0e0d-47ba-99ba-65feda4ae7ba admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.597259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c28154-0e0d-47ba-99ba-65feda4ae7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.599203 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c28154-0e0d-47ba-99ba-65feda4ae7ba admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.625630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1301/2603] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:19 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:53:19.630318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30be0b-a370-4515-b029-402ab240ea72 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.647053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30be0b-a370-4515-b029-402ab240ea72 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.651938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b932-4d91-49a0-be9a-c86918846342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.653041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b932-4d91-49a0-be9a-c86918846342 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.653041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b932-4d91-49a0-be9a-c86918846342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.653349 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b932-4d91-49a0-be9a-c86918846342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.653858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27b932-4d91-49a0-be9a-c86918846342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.655527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27b932-4d91-49a0-be9a-c86918846342 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.670647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1303/2604] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:53:19.674649 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c28154-0e0d-47ba-99ba-65feda4ae7ba admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.685199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c28154-0e0d-47ba-99ba-65feda4ae7ba admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.690331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f51c47-9763-42f9-8aff-bfaae1fe6071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.691482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51c47-9763-42f9-8aff-bfaae1fe6071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.691806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51c47-9763-42f9-8aff-bfaae1fe6071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.692048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51c47-9763-42f9-8aff-bfaae1fe6071 admin admin] PATH_INFO: `/v3/projects/cf16d9879c91441ba18ca2c114897694/users/db7436e86e74495db07695f8bd7548cb/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.708084 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f51c47-9763-42f9-8aff-bfaae1fe6071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf16d9879c91441ba18ca2c114897694, user_id=db7436e86e74495db07695f8bd7548cb, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.710828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f51c47-9763-42f9-8aff-bfaae1fe6071 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.725686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1302/2605] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:19 2022] PUT /identity/v3/projects/cf16d9879c91441ba18ca2c114897694/users/db7436e86e74495db07695f8bd7548cb/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:53:19.730518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b932-4d91-49a0-be9a-c86918846342 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.741391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b932-4d91-49a0-be9a-c86918846342 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.801072 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf294ab-349c-4f82-aab6-7f7470c5d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.801742 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf294ab-349c-4f82-aab6-7f7470c5d044 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.802053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf294ab-349c-4f82-aab6-7f7470c5d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.802345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf294ab-349c-4f82-aab6-7f7470c5d044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.803073 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf294ab-349c-4f82-aab6-7f7470c5d044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.804704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf294ab-349c-4f82-aab6-7f7470c5d044 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.815014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1304/2606] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:53:19.818912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f51c47-9763-42f9-8aff-bfaae1fe6071 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.831943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f51c47-9763-42f9-8aff-bfaae1fe6071 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:19.837286 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ec4a-9be7-4051-bdf7-ed5574fc0a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:19.838206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ec4a-9be7-4051-bdf7-ed5574fc0a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.838482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ec4a-9be7-4051-bdf7-ed5574fc0a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.838751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ec4a-9be7-4051-bdf7-ed5574fc0a36 admin admin] PATH_INFO: `/v3/projects/cf16d9879c91441ba18ca2c114897694/users/db7436e86e74495db07695f8bd7548cb/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.840745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928ec4a-9be7-4051-bdf7-ed5574fc0a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf16d9879c91441ba18ca2c114897694, user_id=db7436e86e74495db07695f8bd7548cb, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:19.843728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928ec4a-9be7-4051-bdf7-ed5574fc0a36 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:19.855801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1303/2607] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:19 2022] PUT /identity/v3/projects/cf16d9879c91441ba18ca2c114897694/users/db7436e86e74495db07695f8bd7548cb/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:19.867058 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaec3d0-2d42-4b1d-b41c-cedf3efa0747 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:19.867198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaec3d0-2d42-4b1d-b41c-cedf3efa0747 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:19.867606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaec3d0-2d42-4b1d-b41c-cedf3efa0747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:19.894192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-efaec3d0-2d42-4b1d-b41c-cedf3efa0747 None None] MFA Rules not processed for user `db7436e86e74495db07695f8bd7548cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:19.895396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-efaec3d0-2d42-4b1d-b41c-cedf3efa0747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:19.966712 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1305/2608] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:19.982120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ec4a-9be7-4051-bdf7-ed5574fc0a36 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:19.983665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9928ec4a-9be7-4051-bdf7-ed5574fc0a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:20.045040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ec4a-9be7-4051-bdf7-ed5574fc0a36 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:20.049379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132388d1-e38d-421e-8c4b-90adc2dc3d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:20.051059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132388d1-e38d-421e-8c4b-90adc2dc3d5d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:20.051403 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132388d1-e38d-421e-8c4b-90adc2dc3d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:20.051743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132388d1-e38d-421e-8c4b-90adc2dc3d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:20.067949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132388d1-e38d-421e-8c4b-90adc2dc3d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:20.070591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132388d1-e38d-421e-8c4b-90adc2dc3d5d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:20.083162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1304/2609] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:20.115060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaec3d0-2d42-4b1d-b41c-cedf3efa0747 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:20.192828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaec3d0-2d42-4b1d-b41c-cedf3efa0747 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:20.198422 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:20.199293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:20.199566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:20.199832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] PATH_INFO: `/v3/users/db652ae2fd9542aa89c3c187ffebb95d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:20.201026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db652ae2fd9542aa89c3c187ffebb95d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:20.202971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:20.267474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db652ae2fd9542aa89c3c187ffebb95d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.281322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db652ae2fd9542aa89c3c187ffebb95d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.282094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db652ae2fd9542aa89c3c187ffebb95d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.282720 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db652ae2fd9542aa89c3c187ffebb95d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.290179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db652ae2fd9542aa89c3c187ffebb95d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.306745 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1306/2610] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:20 2022] DELETE /identity/v3/users/db652ae2fd9542aa89c3c187ffebb95d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:20.311078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dc9ef-d26e-4bc4-b2a2-c3a909fd4115 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:20.311823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dc9ef-d26e-4bc4-b2a2-c3a909fd4115 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:20.312108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dc9ef-d26e-4bc4-b2a2-c3a909fd4115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:20.333044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-219dc9ef-d26e-4bc4-b2a2-c3a909fd4115 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:20.334591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-219dc9ef-d26e-4bc4-b2a2-c3a909fd4115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:20.408539 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1305/2611] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:53:20.418252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:20.419735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:20.476774 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4206e19-b393-400f-9c6d-b3a13313fa72 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:20.481159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd307-3bb2-4980-8f2e-648ee4b979c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:20.481822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd307-3bb2-4980-8f2e-648ee4b979c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:20.482135 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd307-3bb2-4980-8f2e-648ee4b979c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:20.482407 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd307-3bb2-4980-8f2e-648ee4b979c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:20.491381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cd307-3bb2-4980-8f2e-648ee4b979c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:20.493331 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cd307-3bb2-4980-8f2e-648ee4b979c1 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:20.502608 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1307/2612] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:53:20.787850 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dc9ef-d26e-4bc4-b2a2-c3a909fd4115 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:20.789541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-219dc9ef-d26e-4bc4-b2a2-c3a909fd4115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:20.802828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dc9ef-d26e-4bc4-b2a2-c3a909fd4115 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:20.811104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:20.812614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:20.812614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:20.812614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] PATH_INFO: `/v3/projects/0c84b0e76bc24cae837dfa39d558f4ab` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:20.814745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c84b0e76bc24cae837dfa39d558f4ab)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:20.827023 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:20.918800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c84b0e76bc24cae837dfa39d558f4ab', 'request_id': 'req-1cde4f81-a972-4251-a356-8ddaa6b99c52'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.925793 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c84b0e76bc24cae837dfa39d558f4ab', 'request_id': 'req-1cde4f81-a972-4251-a356-8ddaa6b99c52'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.944700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c84b0e76bc24cae837dfa39d558f4ab', 'request_id': 'req-1cde4f81-a972-4251-a356-8ddaa6b99c52'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.957241 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] The token cache is being invalidate because project 0c84b0e76bc24cae837dfa39d558f4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:20.957774 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.958674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:20.960494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1306/2613] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:20 2022] DELETE /identity/v3/projects/0c84b0e76bc24cae837dfa39d558f4ab => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:20.965047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd307-3bb2-4980-8f2e-648ee4b979c1 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:20.976443 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd307-3bb2-4980-8f2e-648ee4b979c1 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:21.053528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:21.055380 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.055662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.056101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] PATH_INFO: `/v3/users/db7436e86e74495db07695f8bd7548cb` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.057544 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7436e86e74495db07695f8bd7548cb)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:21.059765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:21.111643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7436e86e74495db07695f8bd7548cb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.125278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7436e86e74495db07695f8bd7548cb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.126241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7436e86e74495db07695f8bd7548cb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.127008 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7436e86e74495db07695f8bd7548cb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.134865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76e3d8f2-4962-4c9a-b973-4a1619bd7e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7436e86e74495db07695f8bd7548cb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.152565 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1308/2614] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:20 2022] DELETE /identity/v3/users/db7436e86e74495db07695f8bd7548cb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:21.443977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:21.445419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:21.458826 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4f81-a972-4251-a356-8ddaa6b99c52 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:21.516477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:21.517331 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.517616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.517890 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] PATH_INFO: `/v3/projects/cf16d9879c91441ba18ca2c114897694` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.519110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf16d9879c91441ba18ca2c114897694)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:21.521000 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:21.564585 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf16d9879c91441ba18ca2c114897694', 'request_id': 'req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.570451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf16d9879c91441ba18ca2c114897694', 'request_id': 'req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.577349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf16d9879c91441ba18ca2c114897694', 'request_id': 'req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.587170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] The token cache is being invalidate because project cf16d9879c91441ba18ca2c114897694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:21.587456 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.588080 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cc6f20e2-bd2d-437c-82f6-fed63db7ebb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:21.589588 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1307/2615] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:21 2022] DELETE /identity/v3/projects/cf16d9879c91441ba18ca2c114897694 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:21.594647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8f2d-9dd0-48bb-939e-f365ecd601d8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.594964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8f2d-9dd0-48bb-939e-f365ecd601d8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.595240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8f2d-9dd0-48bb-939e-f365ecd601d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.613096 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-85aa8f2d-9dd0-48bb-939e-f365ecd601d8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:21.614410 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-85aa8f2d-9dd0-48bb-939e-f365ecd601d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:21.671835 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1309/2616] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:21.679394 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec31b-0318-4de7-b62b-ce1930e0c3e7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.679685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec31b-0318-4de7-b62b-ce1930e0c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.679962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec31b-0318-4de7-b62b-ce1930e0c3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.698409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-609ec31b-0318-4de7-b62b-ce1930e0c3e7 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:21.699626 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-609ec31b-0318-4de7-b62b-ce1930e0c3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:21.707632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1308/2617] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:21.711452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8f2d-9dd0-48bb-939e-f365ecd601d8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:21.721171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8f2d-9dd0-48bb-939e-f365ecd601d8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:21.726022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa5a51-4092-403b-a279-6ecf9c78d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:21.726679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa5a51-4092-403b-a279-6ecf9c78d296 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.726961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa5a51-4092-403b-a279-6ecf9c78d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.727753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa5a51-4092-403b-a279-6ecf9c78d296 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.728728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa5a51-4092-403b-a279-6ecf9c78d296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:53:21.729033 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa5a51-4092-403b-a279-6ecf9c78d296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:21.730695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa5a51-4092-403b-a279-6ecf9c78d296 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:21.746114 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1310/2618] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:53:21.747965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec31b-0318-4de7-b62b-ce1930e0c3e7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:21.756880 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec31b-0318-4de7-b62b-ce1930e0c3e7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:21.761600 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147648ad-ded4-4f37-9327-7299cdfff150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:21.762451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147648ad-ded4-4f37-9327-7299cdfff150 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.762807 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147648ad-ded4-4f37-9327-7299cdfff150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.763234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147648ad-ded4-4f37-9327-7299cdfff150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.764163 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147648ad-ded4-4f37-9327-7299cdfff150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:21.766443 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147648ad-ded4-4f37-9327-7299cdfff150 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:21.790852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1309/2619] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:21 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:53:21.795343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa5a51-4092-403b-a279-6ecf9c78d296 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:21.805084 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa5a51-4092-403b-a279-6ecf9c78d296 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:21.858993 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbb683-e4fb-4eda-b6b7-3d884c29633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:21.859654 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbb683-e4fb-4eda-b6b7-3d884c29633a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.859937 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbb683-e4fb-4eda-b6b7-3d884c29633a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.860212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbb683-e4fb-4eda-b6b7-3d884c29633a admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.860896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbb683-e4fb-4eda-b6b7-3d884c29633a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:21.862831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbb683-e4fb-4eda-b6b7-3d884c29633a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:21.881632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1311/2620] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:21 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:21.885734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147648ad-ded4-4f37-9327-7299cdfff150 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:21.895739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147648ad-ded4-4f37-9327-7299cdfff150 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:21.900285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968120d-4161-4cee-8bc8-0444433fc594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:21.900927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968120d-4161-4cee-8bc8-0444433fc594 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.901210 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968120d-4161-4cee-8bc8-0444433fc594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.901480 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968120d-4161-4cee-8bc8-0444433fc594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.902237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968120d-4161-4cee-8bc8-0444433fc594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:21.903813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968120d-4161-4cee-8bc8-0444433fc594 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:21.914165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1310/2621] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:21.918559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbb683-e4fb-4eda-b6b7-3d884c29633a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:21.928796 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbb683-e4fb-4eda-b6b7-3d884c29633a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:21.934299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f57ab7-7b83-4c4c-9575-c635def66ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:21.934954 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57ab7-7b83-4c4c-9575-c635def66ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.935234 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57ab7-7b83-4c4c-9575-c635def66ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.935509 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57ab7-7b83-4c4c-9575-c635def66ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.936295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57ab7-7b83-4c4c-9575-c635def66ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:21.938040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57ab7-7b83-4c4c-9575-c635def66ea9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:21.948040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1312/2622] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:21.952097 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968120d-4161-4cee-8bc8-0444433fc594 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:21.962846 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968120d-4161-4cee-8bc8-0444433fc594 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:21.968749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18858db4-7d60-4e5e-875c-b628f6a3d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:21.969416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18858db4-7d60-4e5e-875c-b628f6a3d69b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:21.969699 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18858db4-7d60-4e5e-875c-b628f6a3d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:21.969973 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18858db4-7d60-4e5e-875c-b628f6a3d69b admin admin] PATH_INFO: `/v3/projects/bdf2a029e95c45ea926cf107ab534d15/users/8c565523e1074ef8a2440a0268d6c50e/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:21.986249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18858db4-7d60-4e5e-875c-b628f6a3d69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf2a029e95c45ea926cf107ab534d15, user_id=8c565523e1074ef8a2440a0268d6c50e, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:21.989189 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18858db4-7d60-4e5e-875c-b628f6a3d69b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.003707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1311/2623] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:21 2022] PUT /identity/v3/projects/bdf2a029e95c45ea926cf107ab534d15/users/8c565523e1074ef8a2440a0268d6c50e/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:22.015741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc06c2-24ba-49ed-b70c-6d419d170608 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.016304 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc06c2-24ba-49ed-b70c-6d419d170608 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.016402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc06c2-24ba-49ed-b70c-6d419d170608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.047832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7abc06c2-24ba-49ed-b70c-6d419d170608 None None] MFA Rules not processed for user `8c565523e1074ef8a2440a0268d6c50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:22.049334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7abc06c2-24ba-49ed-b70c-6d419d170608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:22.111188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1313/2624] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:22.115681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18858db4-7d60-4e5e-875c-b628f6a3d69b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.175258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18858db4-7d60-4e5e-875c-b628f6a3d69b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.179933 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc99d83-1b0a-4203-a0d5-ddf78cbda2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.180589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99d83-1b0a-4203-a0d5-ddf78cbda2db admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.180883 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99d83-1b0a-4203-a0d5-ddf78cbda2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.181148 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99d83-1b0a-4203-a0d5-ddf78cbda2db admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.181828 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc99d83-1b0a-4203-a0d5-ddf78cbda2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.183741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc99d83-1b0a-4203-a0d5-ddf78cbda2db admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.208242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1312/2625] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:22 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:22.212847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc06c2-24ba-49ed-b70c-6d419d170608 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.223531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc06c2-24ba-49ed-b70c-6d419d170608 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.279274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24456125-4029-40e6-8e7d-48ae245c25a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.279973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24456125-4029-40e6-8e7d-48ae245c25a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.280258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24456125-4029-40e6-8e7d-48ae245c25a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.280534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24456125-4029-40e6-8e7d-48ae245c25a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.281234 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24456125-4029-40e6-8e7d-48ae245c25a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.283232 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24456125-4029-40e6-8e7d-48ae245c25a8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.302868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1314/2626] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:22 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:22.307167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc99d83-1b0a-4203-a0d5-ddf78cbda2db admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.317263 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc99d83-1b0a-4203-a0d5-ddf78cbda2db admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.322479 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a9fa0-42b9-4b00-8f75-6832096e855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.323111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9fa0-42b9-4b00-8f75-6832096e855d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.323395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9fa0-42b9-4b00-8f75-6832096e855d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.323671 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9fa0-42b9-4b00-8f75-6832096e855d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.324391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a9fa0-42b9-4b00-8f75-6832096e855d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.325980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a9fa0-42b9-4b00-8f75-6832096e855d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.336187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1313/2627] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:22.340839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24456125-4029-40e6-8e7d-48ae245c25a8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.350884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24456125-4029-40e6-8e7d-48ae245c25a8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.355828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b465acb-1d6a-48ff-bb72-42c47d491bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.356477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465acb-1d6a-48ff-bb72-42c47d491bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.356761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465acb-1d6a-48ff-bb72-42c47d491bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.357061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465acb-1d6a-48ff-bb72-42c47d491bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.357779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b465acb-1d6a-48ff-bb72-42c47d491bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.359502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b465acb-1d6a-48ff-bb72-42c47d491bd0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.369075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1315/2628] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:22.373222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a9fa0-42b9-4b00-8f75-6832096e855d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.382801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a9fa0-42b9-4b00-8f75-6832096e855d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.387920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65952a9-bf03-4a2e-b253-4b37a64db410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.388778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65952a9-bf03-4a2e-b253-4b37a64db410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.389060 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65952a9-bf03-4a2e-b253-4b37a64db410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.389334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65952a9-bf03-4a2e-b253-4b37a64db410 admin admin] PATH_INFO: `/v3/projects/e708ab7584bc49e989e9eead2e8f9324/users/8fd84043a8a3432ca513c7fe12a3d363/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.403833 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65952a9-bf03-4a2e-b253-4b37a64db410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e708ab7584bc49e989e9eead2e8f9324, user_id=8fd84043a8a3432ca513c7fe12a3d363, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.406510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65952a9-bf03-4a2e-b253-4b37a64db410 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.422884 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1314/2629] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:22 2022] PUT /identity/v3/projects/e708ab7584bc49e989e9eead2e8f9324/users/8fd84043a8a3432ca513c7fe12a3d363/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:22.436602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc990-1741-470a-aaef-95d6be5abe77 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.436891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc990-1741-470a-aaef-95d6be5abe77 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.437172 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc990-1741-470a-aaef-95d6be5abe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.463149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ccecc990-1741-470a-aaef-95d6be5abe77 None None] MFA Rules not processed for user `8fd84043a8a3432ca513c7fe12a3d363`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:22.464264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ccecc990-1741-470a-aaef-95d6be5abe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:22.527793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1316/2630] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:22.532226 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65952a9-bf03-4a2e-b253-4b37a64db410 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.592463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65952a9-bf03-4a2e-b253-4b37a64db410 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.597173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03f46-c70a-4d81-9636-9eb2a218a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.597852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03f46-c70a-4d81-9636-9eb2a218a811 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.598173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03f46-c70a-4d81-9636-9eb2a218a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.598454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03f46-c70a-4d81-9636-9eb2a218a811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.599177 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f03f46-c70a-4d81-9636-9eb2a218a811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.601120 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f03f46-c70a-4d81-9636-9eb2a218a811 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.625746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1315/2631] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:22 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:22.629889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc990-1741-470a-aaef-95d6be5abe77 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.641208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc990-1741-470a-aaef-95d6be5abe77 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.697183 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c0670-9baa-4c11-8269-479ba902572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.697850 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0670-9baa-4c11-8269-479ba902572e admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.698184 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0670-9baa-4c11-8269-479ba902572e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.698461 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0670-9baa-4c11-8269-479ba902572e admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.702257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c0670-9baa-4c11-8269-479ba902572e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.702257 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c0670-9baa-4c11-8269-479ba902572e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.725425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1317/2632] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:22 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:22.730121 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03f46-c70a-4d81-9636-9eb2a218a811 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.740537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03f46-c70a-4d81-9636-9eb2a218a811 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.746088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f8ed4-60e7-4483-a4db-448694bedcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.746740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f8ed4-60e7-4483-a4db-448694bedcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.747024 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f8ed4-60e7-4483-a4db-448694bedcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.747302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f8ed4-60e7-4483-a4db-448694bedcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.748029 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f8ed4-60e7-4483-a4db-448694bedcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.749622 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f8ed4-60e7-4483-a4db-448694bedcc0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.760688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1316/2633] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:22.765354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c0670-9baa-4c11-8269-479ba902572e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.775598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c0670-9baa-4c11-8269-479ba902572e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.780150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d6096-e35f-4583-9c30-de1cbc78964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.781016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d6096-e35f-4583-9c30-de1cbc78964c admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.781296 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d6096-e35f-4583-9c30-de1cbc78964c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.781572 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d6096-e35f-4583-9c30-de1cbc78964c admin admin] PATH_INFO: `/v3/projects/76a7e5782d824d669cb6e99d00f057ce/users/d5b18255b9e2406889c521356801ac3b/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.795690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d6096-e35f-4583-9c30-de1cbc78964c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a7e5782d824d669cb6e99d00f057ce, user_id=d5b18255b9e2406889c521356801ac3b, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.800382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d6096-e35f-4583-9c30-de1cbc78964c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.813648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1318/2634] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:22 2022] PUT /identity/v3/projects/76a7e5782d824d669cb6e99d00f057ce/users/d5b18255b9e2406889c521356801ac3b/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:22.817582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f8ed4-60e7-4483-a4db-448694bedcc0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.827912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f8ed4-60e7-4483-a4db-448694bedcc0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.881146 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce357e86-75fc-4656-9518-0840871d68c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.881799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce357e86-75fc-4656-9518-0840871d68c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.882111 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce357e86-75fc-4656-9518-0840871d68c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.882384 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce357e86-75fc-4656-9518-0840871d68c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.883100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce357e86-75fc-4656-9518-0840871d68c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.885291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce357e86-75fc-4656-9518-0840871d68c5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.894569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1317/2635] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:22.899055 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d6096-e35f-4583-9c30-de1cbc78964c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:22.909356 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d6096-e35f-4583-9c30-de1cbc78964c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:22.914188 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b776a3-498d-4178-bb83-de48eb9a41a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:22.915052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b776a3-498d-4178-bb83-de48eb9a41a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.915339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b776a3-498d-4178-bb83-de48eb9a41a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.915615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b776a3-498d-4178-bb83-de48eb9a41a9 admin admin] PATH_INFO: `/v3/projects/76a7e5782d824d669cb6e99d00f057ce/users/d5b18255b9e2406889c521356801ac3b/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.917563 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b776a3-498d-4178-bb83-de48eb9a41a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a7e5782d824d669cb6e99d00f057ce, user_id=d5b18255b9e2406889c521356801ac3b, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:22.920221 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b776a3-498d-4178-bb83-de48eb9a41a9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:22.930030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1319/2636] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:22 2022] PUT /identity/v3/projects/76a7e5782d824d669cb6e99d00f057ce/users/d5b18255b9e2406889c521356801ac3b/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 15:53:22.940460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdc9cb-a444-4e92-980d-85993434ccbc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:22.940746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdc9cb-a444-4e92-980d-85993434ccbc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:22.941055 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdc9cb-a444-4e92-980d-85993434ccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:22.966961 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bcfdc9cb-a444-4e92-980d-85993434ccbc None None] MFA Rules not processed for user `d5b18255b9e2406889c521356801ac3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:22.968196 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bcfdc9cb-a444-4e92-980d-85993434ccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:23.040656 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1318/2637] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:23.051899 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b776a3-498d-4178-bb83-de48eb9a41a9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:23.053664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-57b776a3-498d-4178-bb83-de48eb9a41a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:23.112240 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b776a3-498d-4178-bb83-de48eb9a41a9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:23.116606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e91044-71b4-41e2-8dfd-b6ce639eb758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:23.117281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91044-71b4-41e2-8dfd-b6ce639eb758 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:23.117564 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91044-71b4-41e2-8dfd-b6ce639eb758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:23.118549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91044-71b4-41e2-8dfd-b6ce639eb758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:23.128199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e91044-71b4-41e2-8dfd-b6ce639eb758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:23.129644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e91044-71b4-41e2-8dfd-b6ce639eb758 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:23.144336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1320/2638] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:23.612568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdc9cb-a444-4e92-980d-85993434ccbc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:23.613956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bcfdc9cb-a444-4e92-980d-85993434ccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:23.625551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdc9cb-a444-4e92-980d-85993434ccbc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:23.629057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc379-190a-4065-b24a-7a688fefa57b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:23.629686 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc379-190a-4065-b24a-7a688fefa57b service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:23.629971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc379-190a-4065-b24a-7a688fefa57b service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:23.630275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc379-190a-4065-b24a-7a688fefa57b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:23.685468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dc379-190a-4065-b24a-7a688fefa57b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:23.686921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dc379-190a-4065-b24a-7a688fefa57b service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:23.695413 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1319/2639] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:25.554748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e91044-71b4-41e2-8dfd-b6ce639eb758 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:25.556192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-63e91044-71b4-41e2-8dfd-b6ce639eb758 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:25.615061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e91044-71b4-41e2-8dfd-b6ce639eb758 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:25.618773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bfe44-2b7a-4998-8dea-4200de374de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:25.619389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bfe44-2b7a-4998-8dea-4200de374de4 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:25.619678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bfe44-2b7a-4998-8dea-4200de374de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:25.619924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bfe44-2b7a-4998-8dea-4200de374de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:25.621820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d24bfe44-2b7a-4998-8dea-4200de374de4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:25.631467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bfe44-2b7a-4998-8dea-4200de374de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:25.632880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bfe44-2b7a-4998-8dea-4200de374de4 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:25.641189 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1321/2640] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:26.269762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc379-190a-4065-b24a-7a688fefa57b service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:26.271399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c34dc379-190a-4065-b24a-7a688fefa57b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:26.386455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc379-190a-4065-b24a-7a688fefa57b service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:26.393007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d5eb6-0e84-4413-a830-289ef37bf690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:26.393663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d5eb6-0e84-4413-a830-289ef37bf690 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:26.393947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d5eb6-0e84-4413-a830-289ef37bf690 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:26.394254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d5eb6-0e84-4413-a830-289ef37bf690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:26.396564 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6c0d5eb6-0e84-4413-a830-289ef37bf690 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:26.422597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d5eb6-0e84-4413-a830-289ef37bf690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:26.425638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d5eb6-0e84-4413-a830-289ef37bf690 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:26.453210 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1320/2641] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:27.745127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bfe44-2b7a-4998-8dea-4200de374de4 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:27.754623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bfe44-2b7a-4998-8dea-4200de374de4 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:27.758145 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370145-a0e3-4bcf-a6d7-7f234d1950f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:27.758907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370145-a0e3-4bcf-a6d7-7f234d1950f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:27.759062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370145-a0e3-4bcf-a6d7-7f234d1950f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:27.759319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370145-a0e3-4bcf-a6d7-7f234d1950f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:27.815440 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29370145-a0e3-4bcf-a6d7-7f234d1950f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:27.816875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29370145-a0e3-4bcf-a6d7-7f234d1950f0 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:27.825908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1322/2642] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:29.816212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d5eb6-0e84-4413-a830-289ef37bf690 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:29.877594 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d5eb6-0e84-4413-a830-289ef37bf690 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:29.882393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:29.883316 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:29.883593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:29.883864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] PATH_INFO: `/v3/users/8c565523e1074ef8a2440a0268d6c50e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:29.885406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c565523e1074ef8a2440a0268d6c50e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:29.887281 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:29.933791 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c565523e1074ef8a2440a0268d6c50e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:29.945748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c565523e1074ef8a2440a0268d6c50e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:29.946439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c565523e1074ef8a2440a0268d6c50e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:29.953225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c565523e1074ef8a2440a0268d6c50e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:29.960508 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c565523e1074ef8a2440a0268d6c50e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:29.966788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1321/2643] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:29 2022] DELETE /identity/v3/users/8c565523e1074ef8a2440a0268d6c50e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:29.971239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911fbbe-934b-45aa-a165-a9dd1838e8a5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:29.971699 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911fbbe-934b-45aa-a165-a9dd1838e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:29.971797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911fbbe-934b-45aa-a165-a9dd1838e8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:29.989445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e911fbbe-934b-45aa-a165-a9dd1838e8a5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:29.990716 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e911fbbe-934b-45aa-a165-a9dd1838e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:30.047109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1323/2644] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:30.057905 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:30.059542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:30.115178 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345841f-2833-4c8b-b28e-e5cfa6f5573f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:30.119445 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ff42e-b6ef-43d7-8272-c358b704e85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:30.120095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ff42e-b6ef-43d7-8272-c358b704e85c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:30.120376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ff42e-b6ef-43d7-8272-c358b704e85c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:30.120650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ff42e-b6ef-43d7-8272-c358b704e85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:30.129754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ff42e-b6ef-43d7-8272-c358b704e85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:30.131216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ff42e-b6ef-43d7-8272-c358b704e85c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:30.144183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1322/2645] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:30.415229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911fbbe-934b-45aa-a165-a9dd1838e8a5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:30.416854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e911fbbe-934b-45aa-a165-a9dd1838e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:30.430658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911fbbe-934b-45aa-a165-a9dd1838e8a5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:30.436180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:30.437053 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:30.437349 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:30.437679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] PATH_INFO: `/v3/projects/bdf2a029e95c45ea926cf107ab534d15` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:30.439916 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf2a029e95c45ea926cf107ab534d15)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:30.441550 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:30.488689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf2a029e95c45ea926cf107ab534d15', 'request_id': 'req-09e2f23b-4258-47cc-ad11-51aa693b3305'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.494895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf2a029e95c45ea926cf107ab534d15', 'request_id': 'req-09e2f23b-4258-47cc-ad11-51aa693b3305'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.502113 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf2a029e95c45ea926cf107ab534d15', 'request_id': 'req-09e2f23b-4258-47cc-ad11-51aa693b3305'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.512305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] The token cache is being invalidate because project bdf2a029e95c45ea926cf107ab534d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:30.512587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.513198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.514753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1324/2646] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:30 2022] DELETE /identity/v3/projects/bdf2a029e95c45ea926cf107ab534d15 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:30.518781 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ff42e-b6ef-43d7-8272-c358b704e85c service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:30.528837 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ff42e-b6ef-43d7-8272-c358b704e85c service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:30.582945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:30.583800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:30.584077 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:30.584348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] PATH_INFO: `/v3/users/8fd84043a8a3432ca513c7fe12a3d363` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:30.585520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd84043a8a3432ca513c7fe12a3d363)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:30.587975 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:30.630244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd84043a8a3432ca513c7fe12a3d363'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.641768 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd84043a8a3432ca513c7fe12a3d363'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.642440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd84043a8a3432ca513c7fe12a3d363'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.648876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd84043a8a3432ca513c7fe12a3d363'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.656243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd84043a8a3432ca513c7fe12a3d363'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:30.662064 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1323/2647] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:30 2022] DELETE /identity/v3/users/8fd84043a8a3432ca513c7fe12a3d363 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:30.918268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:30.919708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:30.933187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2f23b-4258-47cc-ad11-51aa693b3305 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:30.988431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:30.989269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:30.989560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:30.989819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] PATH_INFO: `/v3/projects/e708ab7584bc49e989e9eead2e8f9324` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:30.991005 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e708ab7584bc49e989e9eead2e8f9324)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:30.993441 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:31.035976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e708ab7584bc49e989e9eead2e8f9324', 'request_id': 'req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.041753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e708ab7584bc49e989e9eead2e8f9324', 'request_id': 'req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.047964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e708ab7584bc49e989e9eead2e8f9324', 'request_id': 'req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.059345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] The token cache is being invalidate because project e708ab7584bc49e989e9eead2e8f9324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:31.059627 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.060312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.061856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1325/2648] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:30 2022] DELETE /identity/v3/projects/e708ab7584bc49e989e9eead2e8f9324 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:31.065751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:31.067208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:31.080112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68eadd-682a-4af6-840c-dc6ddba5871e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:31.134187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:31.135059 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:31.135343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:31.135620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] PATH_INFO: `/v3/users/d5b18255b9e2406889c521356801ac3b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:31.136829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b18255b9e2406889c521356801ac3b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:31.138782 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:31.182427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b18255b9e2406889c521356801ac3b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.193318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b18255b9e2406889c521356801ac3b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.194108 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b18255b9e2406889c521356801ac3b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.201140 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b18255b9e2406889c521356801ac3b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.208222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-065126c5-c672-4047-ab19-b18bebd2d5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b18255b9e2406889c521356801ac3b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.214328 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1324/2649] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:31 2022] DELETE /identity/v3/users/d5b18255b9e2406889c521356801ac3b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:31.493983 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:31.495464 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:31.508672 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67fe27-d37a-4155-940e-0fcf5f6d1b5f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:31.569248 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:31.570244 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:31.570531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:31.570859 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] PATH_INFO: `/v3/projects/76a7e5782d824d669cb6e99d00f057ce` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:31.572138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a7e5782d824d669cb6e99d00f057ce)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:31.574098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:31.620238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a7e5782d824d669cb6e99d00f057ce', 'request_id': 'req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.626229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a7e5782d824d669cb6e99d00f057ce', 'request_id': 'req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.633779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a7e5782d824d669cb6e99d00f057ce', 'request_id': 'req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.644318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] The token cache is being invalidate because project 76a7e5782d824d669cb6e99d00f057ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:31.644610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.645216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8038c095-c274-406b-a8ab-6ec0ae5d2a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:31.646807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1326/2650] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:31 2022] DELETE /identity/v3/projects/76a7e5782d824d669cb6e99d00f057ce => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:31.652765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78101ed3-e6a6-4a68-b870-a86d4328699f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:31.653202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78101ed3-e6a6-4a68-b870-a86d4328699f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:31.653604 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78101ed3-e6a6-4a68-b870-a86d4328699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:31.672981 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-78101ed3-e6a6-4a68-b870-a86d4328699f None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:31.674220 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-78101ed3-e6a6-4a68-b870-a86d4328699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:31.732040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1325/2651] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:31.741110 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6b0ba-c6ee-4cc7-8a2b-feae8f0772be None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:31.741392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6b0ba-c6ee-4cc7-8a2b-feae8f0772be None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:31.741686 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6b0ba-c6ee-4cc7-8a2b-feae8f0772be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:31.762506 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d4b6b0ba-c6ee-4cc7-8a2b-feae8f0772be None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:31.764241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d4b6b0ba-c6ee-4cc7-8a2b-feae8f0772be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:31.777127 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1327/2652] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 15:53:31.778584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78101ed3-e6a6-4a68-b870-a86d4328699f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:31.790319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78101ed3-e6a6-4a68-b870-a86d4328699f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:31.795565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0732d2-351c-4750-a63e-89209387ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:31.796224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0732d2-351c-4750-a63e-89209387ef01 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:31.796509 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0732d2-351c-4750-a63e-89209387ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:31.796783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0732d2-351c-4750-a63e-89209387ef01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:31.797512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0732d2-351c-4750-a63e-89209387ef01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:53:31.797821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0732d2-351c-4750-a63e-89209387ef01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:31.799495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0732d2-351c-4750-a63e-89209387ef01 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:31.812432 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1326/2653] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:53:31.816325 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6b0ba-c6ee-4cc7-8a2b-feae8f0772be None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:31.825562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6b0ba-c6ee-4cc7-8a2b-feae8f0772be None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:31.830366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c1e30-ff6b-4929-bf34-1925f283d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:31.831139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1e30-ff6b-4929-bf34-1925f283d458 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:31.831421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1e30-ff6b-4929-bf34-1925f283d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:31.831693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1e30-ff6b-4929-bf34-1925f283d458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:31.832383 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c1e30-ff6b-4929-bf34-1925f283d458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:31.834294 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c1e30-ff6b-4929-bf34-1925f283d458 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:31.863698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1328/2654] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:31 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:31.864770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0732d2-351c-4750-a63e-89209387ef01 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:31.874706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0732d2-351c-4750-a63e-89209387ef01 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:31.933959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dad90-8369-4540-b730-b3f1171bf5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:31.934801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dad90-8369-4540-b730-b3f1171bf5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:31.935157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dad90-8369-4540-b730-b3f1171bf5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:31.935551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dad90-8369-4540-b730-b3f1171bf5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:31.936460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dad90-8369-4540-b730-b3f1171bf5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:31.938441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dad90-8369-4540-b730-b3f1171bf5a3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:31.962452 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1327/2655] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:31 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:53:31.966307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c1e30-ff6b-4929-bf34-1925f283d458 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:31.977722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c1e30-ff6b-4929-bf34-1925f283d458 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:31.982840 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dddd2c-0d39-4101-b7ad-85ad57663389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:31.983317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dddd2c-0d39-4101-b7ad-85ad57663389 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:31.983599 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dddd2c-0d39-4101-b7ad-85ad57663389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:31.983869 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dddd2c-0d39-4101-b7ad-85ad57663389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:31.984585 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dddd2c-0d39-4101-b7ad-85ad57663389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:31.986205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dddd2c-0d39-4101-b7ad-85ad57663389 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:31.998171 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1329/2656] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:32.002454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dad90-8369-4540-b730-b3f1171bf5a3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:32.012303 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dad90-8369-4540-b730-b3f1171bf5a3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:32.016956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283251c1-e19d-49c2-a7eb-f5ce8b318dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:32.017644 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283251c1-e19d-49c2-a7eb-f5ce8b318dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:32.017925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283251c1-e19d-49c2-a7eb-f5ce8b318dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:32.018243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283251c1-e19d-49c2-a7eb-f5ce8b318dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:32.018952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283251c1-e19d-49c2-a7eb-f5ce8b318dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:32.020536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283251c1-e19d-49c2-a7eb-f5ce8b318dfd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:32.031400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1328/2657] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:32.035843 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dddd2c-0d39-4101-b7ad-85ad57663389 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:32.046368 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dddd2c-0d39-4101-b7ad-85ad57663389 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:32.051204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920621f-7ccf-4441-8b2b-7ef16a180349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:32.052085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920621f-7ccf-4441-8b2b-7ef16a180349 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:32.052537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920621f-7ccf-4441-8b2b-7ef16a180349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:32.052971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920621f-7ccf-4441-8b2b-7ef16a180349 admin admin] PATH_INFO: `/v3/projects/8ebf98f51afd45e7a7205329b97e083e/users/b97656cbf8d544cab117759b159dd3b4/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:32.067508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920621f-7ccf-4441-8b2b-7ef16a180349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ebf98f51afd45e7a7205329b97e083e, user_id=b97656cbf8d544cab117759b159dd3b4, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:32.070182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920621f-7ccf-4441-8b2b-7ef16a180349 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:32.083419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1330/2658] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:32 2022] PUT /identity/v3/projects/8ebf98f51afd45e7a7205329b97e083e/users/b97656cbf8d544cab117759b159dd3b4/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:32.095310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666207f-5fbb-43d5-bb08-0de4f6ffa6b9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:32.095805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666207f-5fbb-43d5-bb08-0de4f6ffa6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:32.095888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666207f-5fbb-43d5-bb08-0de4f6ffa6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:32.124514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4666207f-5fbb-43d5-bb08-0de4f6ffa6b9 None None] MFA Rules not processed for user `b97656cbf8d544cab117759b159dd3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:32.125877 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4666207f-5fbb-43d5-bb08-0de4f6ffa6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:32.193234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1329/2659] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:32.205439 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920621f-7ccf-4441-8b2b-7ef16a180349 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:32.207295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4920621f-7ccf-4441-8b2b-7ef16a180349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:32.262219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920621f-7ccf-4441-8b2b-7ef16a180349 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:32.265664 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b09d4-f31f-4e14-9ca3-5cdd173cb8d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:32.266320 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b09d4-f31f-4e14-9ca3-5cdd173cb8d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:32.266598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b09d4-f31f-4e14-9ca3-5cdd173cb8d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:32.266867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b09d4-f31f-4e14-9ca3-5cdd173cb8d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:32.275542 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b09d4-f31f-4e14-9ca3-5cdd173cb8d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:32.276957 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b09d4-f31f-4e14-9ca3-5cdd173cb8d4 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:32.285473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1331/2660] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:55.819560 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666207f-5fbb-43d5-bb08-0de4f6ffa6b9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:55.879208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666207f-5fbb-43d5-bb08-0de4f6ffa6b9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:55.883693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:55.884551 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:55.884833 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:55.885109 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] PATH_INFO: `/v3/users/b97656cbf8d544cab117759b159dd3b4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:55.886917 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97656cbf8d544cab117759b159dd3b4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:55.888838 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:55.932526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97656cbf8d544cab117759b159dd3b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:55.944206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97656cbf8d544cab117759b159dd3b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:55.944852 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97656cbf8d544cab117759b159dd3b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:55.951841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97656cbf8d544cab117759b159dd3b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:55.959191 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97656cbf8d544cab117759b159dd3b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:55.964867 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1330/2661] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:53:55 2022] DELETE /identity/v3/users/b97656cbf8d544cab117759b159dd3b4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:55.969302 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc8fc2-f58b-48a7-a97b-8774c1589e70 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:55.969788 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc8fc2-f58b-48a7-a97b-8774c1589e70 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:55.969892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc8fc2-f58b-48a7-a97b-8774c1589e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:55.986903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-85fc8fc2-f58b-48a7-a97b-8774c1589e70 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:55.988128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-85fc8fc2-f58b-48a7-a97b-8774c1589e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:56.043354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1332/2662] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:56.052737 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:56.054162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:56.108453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02f403-0f89-447e-9116-3616ef330d41 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:56.112098 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d027f-791b-4ff2-afad-6f12e3ba05a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:56.112726 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d027f-791b-4ff2-afad-6f12e3ba05a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.113009 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d027f-791b-4ff2-afad-6f12e3ba05a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.113284 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d027f-791b-4ff2-afad-6f12e3ba05a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.122654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d027f-791b-4ff2-afad-6f12e3ba05a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:56.124058 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d027f-791b-4ff2-afad-6f12e3ba05a0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:56.133170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1331/2663] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:53:56.391365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc8fc2-f58b-48a7-a97b-8774c1589e70 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:56.392780 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-85fc8fc2-f58b-48a7-a97b-8774c1589e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:56.404671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc8fc2-f58b-48a7-a97b-8774c1589e70 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:56.409382 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:56.410272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.410554 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.410856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] PATH_INFO: `/v3/projects/8ebf98f51afd45e7a7205329b97e083e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.412158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ebf98f51afd45e7a7205329b97e083e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:56.414137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:56.460150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ebf98f51afd45e7a7205329b97e083e', 'request_id': 'req-f12417c1-287b-4d33-9228-5704c196edad'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:56.466308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ebf98f51afd45e7a7205329b97e083e', 'request_id': 'req-f12417c1-287b-4d33-9228-5704c196edad'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:56.473147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ebf98f51afd45e7a7205329b97e083e', 'request_id': 'req-f12417c1-287b-4d33-9228-5704c196edad'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:56.483660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] The token cache is being invalidate because project 8ebf98f51afd45e7a7205329b97e083e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:53:56.483944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:56.484618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f12417c1-287b-4d33-9228-5704c196edad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:53:56.486238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1333/2664] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:53:56 2022] DELETE /identity/v3/projects/8ebf98f51afd45e7a7205329b97e083e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:56.491293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68742fc0-8b7a-416b-848f-714385d89cdc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.491580 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68742fc0-8b7a-416b-848f-714385d89cdc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.491854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68742fc0-8b7a-416b-848f-714385d89cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.509199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-68742fc0-8b7a-416b-848f-714385d89cdc None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:56.510449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-68742fc0-8b7a-416b-848f-714385d89cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:56.566591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1332/2665] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:56.576029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c5792-0c19-4986-8325-39a03818bc8c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.576318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c5792-0c19-4986-8325-39a03818bc8c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.576594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c5792-0c19-4986-8325-39a03818bc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.594765 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b36c5792-0c19-4986-8325-39a03818bc8c None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:56.595968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b36c5792-0c19-4986-8325-39a03818bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:56.604152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1334/2666] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:56.608748 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68742fc0-8b7a-416b-848f-714385d89cdc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:56.618401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68742fc0-8b7a-416b-848f-714385d89cdc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:56.623488 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ddb03-1d0b-4402-b883-28b0072716b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:56.624134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ddb03-1d0b-4402-b883-28b0072716b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.624416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ddb03-1d0b-4402-b883-28b0072716b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.624693 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ddb03-1d0b-4402-b883-28b0072716b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.625414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ddb03-1d0b-4402-b883-28b0072716b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:53:56.625717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ddb03-1d0b-4402-b883-28b0072716b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:56.627329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ddb03-1d0b-4402-b883-28b0072716b7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:56.638888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1333/2667] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:53:56.643153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c5792-0c19-4986-8325-39a03818bc8c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:56.652252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c5792-0c19-4986-8325-39a03818bc8c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:56.656918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539813ca-2edf-4523-bccc-ea68622cdf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:56.657562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539813ca-2edf-4523-bccc-ea68622cdf54 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.657853 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539813ca-2edf-4523-bccc-ea68622cdf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.658160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539813ca-2edf-4523-bccc-ea68622cdf54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.658839 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539813ca-2edf-4523-bccc-ea68622cdf54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:56.660760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539813ca-2edf-4523-bccc-ea68622cdf54 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:56.685754 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1335/2668] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:53:56 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:56.689766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ddb03-1d0b-4402-b883-28b0072716b7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:56.699951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ddb03-1d0b-4402-b883-28b0072716b7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:56.753677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d083f9-4dcf-4fba-9213-ddf74b5674f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:56.754324 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d083f9-4dcf-4fba-9213-ddf74b5674f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.754647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d083f9-4dcf-4fba-9213-ddf74b5674f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.754910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d083f9-4dcf-4fba-9213-ddf74b5674f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.755597 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d083f9-4dcf-4fba-9213-ddf74b5674f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:56.757493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d083f9-4dcf-4fba-9213-ddf74b5674f7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:56.777831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1334/2669] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:53:56 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:53:56.782087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539813ca-2edf-4523-bccc-ea68622cdf54 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:56.792752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539813ca-2edf-4523-bccc-ea68622cdf54 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:56.797339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bedb5-8e19-4c30-bccb-5474b0ef5790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:56.797990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bedb5-8e19-4c30-bccb-5474b0ef5790 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.798299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bedb5-8e19-4c30-bccb-5474b0ef5790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.798574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bedb5-8e19-4c30-bccb-5474b0ef5790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.799288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bedb5-8e19-4c30-bccb-5474b0ef5790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:56.800880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bedb5-8e19-4c30-bccb-5474b0ef5790 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:56.811540 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1336/2670] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:56.815358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d083f9-4dcf-4fba-9213-ddf74b5674f7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:56.824924 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d083f9-4dcf-4fba-9213-ddf74b5674f7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:56.829636 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb2402-1881-4ba8-8b91-bcd582952096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:56.830319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb2402-1881-4ba8-8b91-bcd582952096 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.830606 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb2402-1881-4ba8-8b91-bcd582952096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.830882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb2402-1881-4ba8-8b91-bcd582952096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.831605 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb2402-1881-4ba8-8b91-bcd582952096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:56.833186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb2402-1881-4ba8-8b91-bcd582952096 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:56.842823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1335/2671] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:53:56.846696 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bedb5-8e19-4c30-bccb-5474b0ef5790 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:56.857020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bedb5-8e19-4c30-bccb-5474b0ef5790 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:56.861553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46da5b4-42e0-4165-989c-83480a39c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:56.862451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46da5b4-42e0-4165-989c-83480a39c609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.862729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46da5b4-42e0-4165-989c-83480a39c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.863001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46da5b4-42e0-4165-989c-83480a39c609 admin admin] PATH_INFO: `/v3/projects/de5ea6e03f1447cb9282a899377f11e5/users/a5fecd8f8f50493f986acca7bc9d2b3f/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.877381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46da5b4-42e0-4165-989c-83480a39c609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5ea6e03f1447cb9282a899377f11e5, user_id=a5fecd8f8f50493f986acca7bc9d2b3f, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:56.880018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46da5b4-42e0-4165-989c-83480a39c609 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:56.892209 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1337/2672] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:53:56 2022] PUT /identity/v3/projects/de5ea6e03f1447cb9282a899377f11e5/users/a5fecd8f8f50493f986acca7bc9d2b3f/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:53:56.902408 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072eca2-c2a1-4b17-84c2-8eaaab780ba8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:56.902700 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072eca2-c2a1-4b17-84c2-8eaaab780ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:56.903001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072eca2-c2a1-4b17-84c2-8eaaab780ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:56.928864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d072eca2-c2a1-4b17-84c2-8eaaab780ba8 None None] MFA Rules not processed for user `a5fecd8f8f50493f986acca7bc9d2b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:53:56.930073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d072eca2-c2a1-4b17-84c2-8eaaab780ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:56.991548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1336/2673] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:53:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:53:57.003964 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46da5b4-42e0-4165-989c-83480a39c609 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:53:57.005677 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c46da5b4-42e0-4165-989c-83480a39c609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:53:57.060192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46da5b4-42e0-4165-989c-83480a39c609 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:53:57.063817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b6c6-6321-482c-81c5-1acf5491573d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22c0e889e1f842b2a6081f38aabd97ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:53:57.064447 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b6c6-6321-482c-81c5-1acf5491573d service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:53:57.064727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b6c6-6321-482c-81c5-1acf5491573d service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:53:57.065001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b6c6-6321-482c-81c5-1acf5491573d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:53:57.073026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2b6c6-6321-482c-81c5-1acf5491573d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:53:57.074522 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2b6c6-6321-482c-81c5-1acf5491573d service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:53:57.083067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1338/2674] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:53:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:54:42.695409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072eca2-c2a1-4b17-84c2-8eaaab780ba8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:42.797086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072eca2-c2a1-4b17-84c2-8eaaab780ba8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:42.801577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:42.802524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:42.802804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:42.803087 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] PATH_INFO: `/v3/users/a5fecd8f8f50493f986acca7bc9d2b3f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:42.804275 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fecd8f8f50493f986acca7bc9d2b3f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:42.806200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:42.852129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fecd8f8f50493f986acca7bc9d2b3f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:42.863784 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fecd8f8f50493f986acca7bc9d2b3f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:42.864440 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fecd8f8f50493f986acca7bc9d2b3f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:42.871073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fecd8f8f50493f986acca7bc9d2b3f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:42.877833 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fecd8f8f50493f986acca7bc9d2b3f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:42.884089 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1337/2675] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:54:42 2022] DELETE /identity/v3/users/a5fecd8f8f50493f986acca7bc9d2b3f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:54:42.888642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9621feb-0d85-419c-8d2f-fec91ac6bf6e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:42.889136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9621feb-0d85-419c-8d2f-fec91ac6bf6e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:42.890406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9621feb-0d85-419c-8d2f-fec91ac6bf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:42.935117 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e9621feb-0d85-419c-8d2f-fec91ac6bf6e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:54:42.937363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e9621feb-0d85-419c-8d2f-fec91ac6bf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:42.993193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1339/2676] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:54:43.004181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:43.005579 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:43.095516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb059f-684b-47bb-bbb1-8b23316eefe6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:43.099174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189688e-f25c-43b8-95d1-25741e70fd64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:43.099848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189688e-f25c-43b8-95d1-25741e70fd64 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.100130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189688e-f25c-43b8-95d1-25741e70fd64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.100406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189688e-f25c-43b8-95d1-25741e70fd64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.110038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189688e-f25c-43b8-95d1-25741e70fd64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:43.111461 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189688e-f25c-43b8-95d1-25741e70fd64 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:43.120591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1338/2677] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 15:54:43.373944 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9621feb-0d85-419c-8d2f-fec91ac6bf6e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:43.375378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e9621feb-0d85-419c-8d2f-fec91ac6bf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:43.387151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9621feb-0d85-419c-8d2f-fec91ac6bf6e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:43.392143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:43.393002 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.393283 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.393552 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] PATH_INFO: `/v3/projects/de5ea6e03f1447cb9282a899377f11e5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.394785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5ea6e03f1447cb9282a899377f11e5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:43.396777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:43.441904 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5ea6e03f1447cb9282a899377f11e5', 'request_id': 'req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:43.447880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5ea6e03f1447cb9282a899377f11e5', 'request_id': 'req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:43.455197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5ea6e03f1447cb9282a899377f11e5', 'request_id': 'req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:43.465743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] The token cache is being invalidate because project de5ea6e03f1447cb9282a899377f11e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:54:43.465968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:43.466621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9dbdd7c0-d0f5-44aa-b13c-5e753bd6ca6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:54:43.468759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1340/2678] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:54:43 2022] DELETE /identity/v3/projects/de5ea6e03f1447cb9282a899377f11e5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:54:43.473937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69025fc9-35d4-406e-aac7-1f978222da02 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.474272 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69025fc9-35d4-406e-aac7-1f978222da02 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.474552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69025fc9-35d4-406e-aac7-1f978222da02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.520021 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-69025fc9-35d4-406e-aac7-1f978222da02 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:54:43.521231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-69025fc9-35d4-406e-aac7-1f978222da02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:43.575909 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1339/2679] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:54:43.584971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb2575-28b4-4612-b584-98b9ee6306f7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.585264 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb2575-28b4-4612-b584-98b9ee6306f7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.585545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb2575-28b4-4612-b584-98b9ee6306f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.604573 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4fcb2575-28b4-4612-b584-98b9ee6306f7 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:54:43.605762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4fcb2575-28b4-4612-b584-98b9ee6306f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:43.613621 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1341/2680] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:54:43.617550 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69025fc9-35d4-406e-aac7-1f978222da02 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:43.627451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69025fc9-35d4-406e-aac7-1f978222da02 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:43.632100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e86211-eb33-47e9-a921-dd854bb92730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:43.632740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86211-eb33-47e9-a921-dd854bb92730 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.633119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86211-eb33-47e9-a921-dd854bb92730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.633399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86211-eb33-47e9-a921-dd854bb92730 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.634159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e86211-eb33-47e9-a921-dd854bb92730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:54:43.634492 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e86211-eb33-47e9-a921-dd854bb92730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:43.636073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e86211-eb33-47e9-a921-dd854bb92730 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:43.647765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1340/2681] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 15:54:43.651908 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb2575-28b4-4612-b584-98b9ee6306f7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:43.660994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb2575-28b4-4612-b584-98b9ee6306f7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:43.665619 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877cf5f-0e3f-459f-88b5-70cada5446ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:43.666290 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877cf5f-0e3f-459f-88b5-70cada5446ac admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.666575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877cf5f-0e3f-459f-88b5-70cada5446ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.666854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877cf5f-0e3f-459f-88b5-70cada5446ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.667530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877cf5f-0e3f-459f-88b5-70cada5446ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:43.669412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877cf5f-0e3f-459f-88b5-70cada5446ac admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:43.694108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1342/2682] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:54:43 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:54:43.698127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e86211-eb33-47e9-a921-dd854bb92730 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:43.708552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e86211-eb33-47e9-a921-dd854bb92730 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:43.763691 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a6d87-5de0-4e9f-bd7a-64c3c33d2bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:43.764277 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a6d87-5de0-4e9f-bd7a-64c3c33d2bff admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.765163 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a6d87-5de0-4e9f-bd7a-64c3c33d2bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.765464 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a6d87-5de0-4e9f-bd7a-64c3c33d2bff admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.766190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a6d87-5de0-4e9f-bd7a-64c3c33d2bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:43.768113 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a6d87-5de0-4e9f-bd7a-64c3c33d2bff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:43.787101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1341/2683] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:54:43 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:54:43.791109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877cf5f-0e3f-459f-88b5-70cada5446ac admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:43.801019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877cf5f-0e3f-459f-88b5-70cada5446ac admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:43.805530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3b36a-8de1-4e3e-9164-1f6e185dbc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:43.806204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3b36a-8de1-4e3e-9164-1f6e185dbc1d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.806485 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3b36a-8de1-4e3e-9164-1f6e185dbc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.806757 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3b36a-8de1-4e3e-9164-1f6e185dbc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.807470 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3b36a-8de1-4e3e-9164-1f6e185dbc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:43.809045 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3b36a-8de1-4e3e-9164-1f6e185dbc1d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:43.819451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1343/2684] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 15:54:43.823228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a6d87-5de0-4e9f-bd7a-64c3c33d2bff admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:43.833840 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a6d87-5de0-4e9f-bd7a-64c3c33d2bff admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:43.838510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38918c-dbea-4899-933d-db8ec13cbe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:43.839155 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38918c-dbea-4899-933d-db8ec13cbe7e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.839441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38918c-dbea-4899-933d-db8ec13cbe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.839717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38918c-dbea-4899-933d-db8ec13cbe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.840442 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38918c-dbea-4899-933d-db8ec13cbe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:43.842074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38918c-dbea-4899-933d-db8ec13cbe7e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:43.851637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1342/2685] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:54:43.855738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3b36a-8de1-4e3e-9164-1f6e185dbc1d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:43.865392 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3b36a-8de1-4e3e-9164-1f6e185dbc1d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:43.869885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43be6d-3aa4-4f27-b9d3-d6221050fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:43.870762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43be6d-3aa4-4f27-b9d3-d6221050fe5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.871038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43be6d-3aa4-4f27-b9d3-d6221050fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.871307 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43be6d-3aa4-4f27-b9d3-d6221050fe5f admin admin] PATH_INFO: `/v3/projects/8636ddd509654ba48dc18dc2837ee0df/users/4b5965b27f1b4ca38680e50363765387/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.885604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43be6d-3aa4-4f27-b9d3-d6221050fe5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8636ddd509654ba48dc18dc2837ee0df, user_id=4b5965b27f1b4ca38680e50363765387, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:43.888239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43be6d-3aa4-4f27-b9d3-d6221050fe5f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:43.901415 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1344/2686] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:54:43 2022] PUT /identity/v3/projects/8636ddd509654ba48dc18dc2837ee0df/users/4b5965b27f1b4ca38680e50363765387/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:54:43.906378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3ef6-8119-4cb2-8252-46bb6b136db7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:43.906675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3ef6-8119-4cb2-8252-46bb6b136db7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:43.906949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3ef6-8119-4cb2-8252-46bb6b136db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:43.924653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-892b3ef6-8119-4cb2-8252-46bb6b136db7 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:54:43.925855 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-892b3ef6-8119-4cb2-8252-46bb6b136db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:43.981312 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1343/2687] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:54:43.991132 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43be6d-3aa4-4f27-b9d3-d6221050fe5f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:43.992893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2e43be6d-3aa4-4f27-b9d3-d6221050fe5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:44.046476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43be6d-3aa4-4f27-b9d3-d6221050fe5f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:44.049939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ea799-37fb-4948-8939-166fb68755bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:44.050662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ea799-37fb-4948-8939-166fb68755bc service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:44.050940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ea799-37fb-4948-8939-166fb68755bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:44.051211 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ea799-37fb-4948-8939-166fb68755bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:44.059834 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ea799-37fb-4948-8939-166fb68755bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:44.061250 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ea799-37fb-4948-8939-166fb68755bc service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:44.070923 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1345/2688] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:54:47.878943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27227a22-b470-4699-b42c-79a08c5ffc74 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:47.880001 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27227a22-b470-4699-b42c-79a08c5ffc74 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:47.880627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27227a22-b470-4699-b42c-79a08c5ffc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:47.914259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-27227a22-b470-4699-b42c-79a08c5ffc74 None None] MFA Rules not processed for user `4b5965b27f1b4ca38680e50363765387`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:54:47.915529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-27227a22-b470-4699-b42c-79a08c5ffc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:47.984362 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1344/2689] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:54:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:54:47.988953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ea799-37fb-4948-8939-166fb68755bc service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:47.998351 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ea799-37fb-4948-8939-166fb68755bc service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:48.003539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eb18b-4be0-4f35-9b51-77f297c23c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:48.004191 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eb18b-4be0-4f35-9b51-77f297c23c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:48.004479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eb18b-4be0-4f35-9b51-77f297c23c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:48.004766 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eb18b-4be0-4f35-9b51-77f297c23c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:48.005451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eb18b-4be0-4f35-9b51-77f297c23c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:48.007394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eb18b-4be0-4f35-9b51-77f297c23c96 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:48.036044 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1346/2690] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:54:47 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:54:48.038910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27227a22-b470-4699-b42c-79a08c5ffc74 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:48.050937 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27227a22-b470-4699-b42c-79a08c5ffc74 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:48.106724 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273ab9-0417-454e-a931-2fe34ea67cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:48.107388 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273ab9-0417-454e-a931-2fe34ea67cef admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:48.107668 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273ab9-0417-454e-a931-2fe34ea67cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:48.107941 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273ab9-0417-454e-a931-2fe34ea67cef admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:48.109199 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19273ab9-0417-454e-a931-2fe34ea67cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:48.111150 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19273ab9-0417-454e-a931-2fe34ea67cef admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:48.130381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1345/2691] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:54:48 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:54:48.134644 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eb18b-4be0-4f35-9b51-77f297c23c96 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:48.145099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eb18b-4be0-4f35-9b51-77f297c23c96 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:48.149776 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5244-f5e6-4492-bdaa-9311cebd36b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:48.150472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5244-f5e6-4492-bdaa-9311cebd36b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:48.150755 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5244-f5e6-4492-bdaa-9311cebd36b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:48.151061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5244-f5e6-4492-bdaa-9311cebd36b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:48.151814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5244-f5e6-4492-bdaa-9311cebd36b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:48.153421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5244-f5e6-4492-bdaa-9311cebd36b5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:48.164559 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1347/2692] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:54:48.168638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273ab9-0417-454e-a931-2fe34ea67cef admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:48.179083 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273ab9-0417-454e-a931-2fe34ea67cef admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:48.184037 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd969e9c-4cc1-4eb5-9655-7ebd6aae64ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:48.184946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd969e9c-4cc1-4eb5-9655-7ebd6aae64ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:48.185229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd969e9c-4cc1-4eb5-9655-7ebd6aae64ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:48.185502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd969e9c-4cc1-4eb5-9655-7ebd6aae64ef admin admin] PATH_INFO: `/v3/projects/64e9d1303dd148d18122eab2b6e330a1/users/e013fb6a986f4843b596c81d5bd496b5/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:48.200952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd969e9c-4cc1-4eb5-9655-7ebd6aae64ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e9d1303dd148d18122eab2b6e330a1, user_id=e013fb6a986f4843b596c81d5bd496b5, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:48.203721 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd969e9c-4cc1-4eb5-9655-7ebd6aae64ef admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:48.216306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1346/2693] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:54:48 2022] PUT /identity/v3/projects/64e9d1303dd148d18122eab2b6e330a1/users/e013fb6a986f4843b596c81d5bd496b5/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:54:48.220813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5244-f5e6-4492-bdaa-9311cebd36b5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:48.231487 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5244-f5e6-4492-bdaa-9311cebd36b5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:48.287759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effc4a3-4df6-4fe3-b765-2b1d8aedcc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:48.288481 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc4a3-4df6-4fe3-b765-2b1d8aedcc01 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:48.288789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc4a3-4df6-4fe3-b765-2b1d8aedcc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:48.289086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc4a3-4df6-4fe3-b765-2b1d8aedcc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:48.289855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc4a3-4df6-4fe3-b765-2b1d8aedcc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:48.291610 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc4a3-4df6-4fe3-b765-2b1d8aedcc01 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:48.302761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1348/2694] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:54:48.306837 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd969e9c-4cc1-4eb5-9655-7ebd6aae64ef admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:48.316829 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd969e9c-4cc1-4eb5-9655-7ebd6aae64ef admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:48.321352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9254857-bf72-4198-967c-6581b329ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:48.322250 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9254857-bf72-4198-967c-6581b329ad4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:48.322529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9254857-bf72-4198-967c-6581b329ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:48.322799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9254857-bf72-4198-967c-6581b329ad4b admin admin] PATH_INFO: `/v3/projects/64e9d1303dd148d18122eab2b6e330a1/users/e013fb6a986f4843b596c81d5bd496b5/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:48.324834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9254857-bf72-4198-967c-6581b329ad4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e9d1303dd148d18122eab2b6e330a1, user_id=e013fb6a986f4843b596c81d5bd496b5, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:48.327419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9254857-bf72-4198-967c-6581b329ad4b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:48.337056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1347/2695] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:54:48 2022] PUT /identity/v3/projects/64e9d1303dd148d18122eab2b6e330a1/users/e013fb6a986f4843b596c81d5bd496b5/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:54:53.095912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92554ed2-c608-4485-8bec-ad0991ca6faf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:53.097205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92554ed2-c608-4485-8bec-ad0991ca6faf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:53.097480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92554ed2-c608-4485-8bec-ad0991ca6faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:53.127115 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-92554ed2-c608-4485-8bec-ad0991ca6faf None None] MFA Rules not processed for user `e013fb6a986f4843b596c81d5bd496b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:54:53.128620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-92554ed2-c608-4485-8bec-ad0991ca6faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:53.206781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1349/2696] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:54:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:54:53.221741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9254857-bf72-4198-967c-6581b329ad4b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:53.223613 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b9254857-bf72-4198-967c-6581b329ad4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:53.285878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9254857-bf72-4198-967c-6581b329ad4b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:53.289844 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b342a-c5d8-48de-b374-6b75a54886df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22c0e889e1f842b2a6081f38aabd97ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:53.290575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b342a-c5d8-48de-b374-6b75a54886df service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:53.290861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b342a-c5d8-48de-b374-6b75a54886df service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:53.291138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b342a-c5d8-48de-b374-6b75a54886df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:53.357836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b342a-c5d8-48de-b374-6b75a54886df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:53.359396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b342a-c5d8-48de-b374-6b75a54886df service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:53.370705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1348/2697] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:54:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:54:53.490727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ba621-18a8-4ce8-8cb8-86b1a5dda577 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:53.491008 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ba621-18a8-4ce8-8cb8-86b1a5dda577 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:53.491590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ba621-18a8-4ce8-8cb8-86b1a5dda577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:53.509890 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-734ba621-18a8-4ce8-8cb8-86b1a5dda577 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:54:53.512126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-734ba621-18a8-4ce8-8cb8-86b1a5dda577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:53.573467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1350/2698] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:54:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:54:53.621637 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b342a-c5d8-48de-b374-6b75a54886df service glance] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:54:53.623110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3a5b342a-c5d8-48de-b374-6b75a54886df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:54:53.690549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b342a-c5d8-48de-b374-6b75a54886df service glance] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:54:53.695524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ed16a-965a-47a0-a68a-cefc6284f995 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:54:53.696259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ed16a-965a-47a0-a68a-cefc6284f995 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:54:53.696548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ed16a-965a-47a0-a68a-cefc6284f995 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:54:53.696827 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ed16a-965a-47a0-a68a-cefc6284f995 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:54:53.704683 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ed16a-965a-47a0-a68a-cefc6284f995 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:54:53.706294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ed16a-965a-47a0-a68a-cefc6284f995 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:54:53.715057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1349/2699] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:54:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:55:02.224039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e361eb-74be-48cc-9c2a-228615590039 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:55:02.224633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e361eb-74be-48cc-9c2a-228615590039 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:55:02.224633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e361eb-74be-48cc-9c2a-228615590039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:55:02.242583 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-58e361eb-74be-48cc-9c2a-228615590039 None None] MFA Rules not processed for user `4b5965b27f1b4ca38680e50363765387`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:55:02.243813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-58e361eb-74be-48cc-9c2a-228615590039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:55:02.251609 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1351/2700] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:55:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:55:02.498318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ed16a-965a-47a0-a68a-cefc6284f995 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:55:02.551107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ed16a-965a-47a0-a68a-cefc6284f995 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:55:02.554553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6009-cc77-4e90-b544-ea2279e5dc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:55:02.555181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6009-cc77-4e90-b544-ea2279e5dc2d service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:55:02.555463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6009-cc77-4e90-b544-ea2279e5dc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:55:02.555739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6009-cc77-4e90-b544-ea2279e5dc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:55:02.557482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9f7d6009-cc77-4e90-b544-ea2279e5dc2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:55:02.566614 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d6009-cc77-4e90-b544-ea2279e5dc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:55:02.568048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d6009-cc77-4e90-b544-ea2279e5dc2d service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:55:02.575918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1350/2701] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:55:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:55:03.903207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e361eb-74be-48cc-9c2a-228615590039 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:55:03.905069 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-58e361eb-74be-48cc-9c2a-228615590039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:55:03.977984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e361eb-74be-48cc-9c2a-228615590039 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:55:03.983281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702c98-9d7a-4d99-892d-e515a16f1acc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:55:03.983923 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702c98-9d7a-4d99-892d-e515a16f1acc service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:55:03.984204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702c98-9d7a-4d99-892d-e515a16f1acc service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:55:03.984480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702c98-9d7a-4d99-892d-e515a16f1acc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:55:03.986334 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab702c98-9d7a-4d99-892d-e515a16f1acc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:55:03.997454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab702c98-9d7a-4d99-892d-e515a16f1acc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:55:03.999586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab702c98-9d7a-4d99-892d-e515a16f1acc service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:55:04.009310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1352/2702] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:55:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:55:05.130251 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d8f1-9495-40e7-ac3d-5e34de685b9c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:55:05.130734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d8f1-9495-40e7-ac3d-5e34de685b9c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:55:05.130839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d8f1-9495-40e7-ac3d-5e34de685b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:55:05.148512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8413d8f1-9495-40e7-ac3d-5e34de685b9c None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:55:05.150174 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8413d8f1-9495-40e7-ac3d-5e34de685b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:55:05.157064 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1351/2703] 10.222.0.75 () {58 vars in 1009 bytes} [Tue May 17 15:55:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:55:05.169106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702c98-9d7a-4d99-892d-e515a16f1acc service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:55:05.180930 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702c98-9d7a-4d99-892d-e515a16f1acc service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:55:05.186508 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb73cc-46cb-44a1-a15e-596f9fac2eb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:55:05.187363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb73cc-46cb-44a1-a15e-596f9fac2eb7 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:55:05.187648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb73cc-46cb-44a1-a15e-596f9fac2eb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:55:05.187924 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb73cc-46cb-44a1-a15e-596f9fac2eb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:55:05.196012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb73cc-46cb-44a1-a15e-596f9fac2eb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:55:05.197586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb73cc-46cb-44a1-a15e-596f9fac2eb7 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:55:05.205771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1353/2704] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:55:26.485797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d8f1-9495-40e7-ac3d-5e34de685b9c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:55:26.487369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8413d8f1-9495-40e7-ac3d-5e34de685b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:55:26.564886 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d8f1-9495-40e7-ac3d-5e34de685b9c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:55:26.570349 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53be10f-2b0e-49aa-a7b0-81579deb2e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:55:26.570989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53be10f-2b0e-49aa-a7b0-81579deb2e15 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:55:26.571272 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53be10f-2b0e-49aa-a7b0-81579deb2e15 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:55:26.571548 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53be10f-2b0e-49aa-a7b0-81579deb2e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:55:26.573302 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c53be10f-2b0e-49aa-a7b0-81579deb2e15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:55:26.585117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53be10f-2b0e-49aa-a7b0-81579deb2e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:55:26.586607 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53be10f-2b0e-49aa-a7b0-81579deb2e15 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:55:26.597190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1352/2705] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:55:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:55:39.878090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb73cc-46cb-44a1-a15e-596f9fac2eb7 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:55:39.879494 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dbcb73cc-46cb-44a1-a15e-596f9fac2eb7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:55:39.891789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb73cc-46cb-44a1-a15e-596f9fac2eb7 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:55:39.895345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed0974-ba8e-4a3b-881a-bc3222ee7c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:55:39.896035 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed0974-ba8e-4a3b-881a-bc3222ee7c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:55:39.896316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed0974-ba8e-4a3b-881a-bc3222ee7c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:55:39.896592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed0974-ba8e-4a3b-881a-bc3222ee7c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:55:39.905398 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed0974-ba8e-4a3b-881a-bc3222ee7c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:55:39.906855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed0974-ba8e-4a3b-881a-bc3222ee7c3f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:55:39.915990 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1354/2706] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:55:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:55:41.459974 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53be10f-2b0e-49aa-a7b0-81579deb2e15 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:55:41.481680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53be10f-2b0e-49aa-a7b0-81579deb2e15 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:55:41.487961 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a548f7-3471-4a64-95b5-15ec392759a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:55:41.488664 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a548f7-3471-4a64-95b5-15ec392759a2 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:55:41.488958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a548f7-3471-4a64-95b5-15ec392759a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:55:41.489231 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a548f7-3471-4a64-95b5-15ec392759a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:55:41.491644 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-50a548f7-3471-4a64-95b5-15ec392759a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:55:41.521310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a548f7-3471-4a64-95b5-15ec392759a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:55:41.523450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a548f7-3471-4a64-95b5-15ec392759a2 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:55:41.535770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1353/2707] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:55:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:56:11.158948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed0974-ba8e-4a3b-881a-bc3222ee7c3f service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:56:11.160337 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2bed0974-ba8e-4a3b-881a-bc3222ee7c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:56:11.197156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed0974-ba8e-4a3b-881a-bc3222ee7c3f service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:56:11.202630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78890-82c5-4a39-ac49-3f225699971c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:56:11.203256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78890-82c5-4a39-ac49-3f225699971c service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:56:11.203535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78890-82c5-4a39-ac49-3f225699971c service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:56:11.203807 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78890-82c5-4a39-ac49-3f225699971c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:56:11.205524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dbd78890-82c5-4a39-ac49-3f225699971c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:56:11.216602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd78890-82c5-4a39-ac49-3f225699971c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:56:11.218797 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd78890-82c5-4a39-ac49-3f225699971c service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:56:11.228387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1355/2708] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:56:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:56:55.149222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a548f7-3471-4a64-95b5-15ec392759a2 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:56:55.159424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a548f7-3471-4a64-95b5-15ec392759a2 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:56:55.163642 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9961c8-335a-465e-9ac0-41f6347555ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:56:55.164291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9961c8-335a-465e-9ac0-41f6347555ed service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:56:55.164596 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9961c8-335a-465e-9ac0-41f6347555ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:56:55.164869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9961c8-335a-465e-9ac0-41f6347555ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:56:55.166718 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aa9961c8-335a-465e-9ac0-41f6347555ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:56:55.180778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9961c8-335a-465e-9ac0-41f6347555ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:56:55.182224 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9961c8-335a-465e-9ac0-41f6347555ed service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:56:55.193465 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1354/2709] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:56:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:58:10.438436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78890-82c5-4a39-ac49-3f225699971c service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:10.448423 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78890-82c5-4a39-ac49-3f225699971c service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:10.452028 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba948fa-c47a-4fe6-8232-e9458d89ba19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:10.452656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba948fa-c47a-4fe6-8232-e9458d89ba19 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:10.452943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba948fa-c47a-4fe6-8232-e9458d89ba19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:10.453219 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba948fa-c47a-4fe6-8232-e9458d89ba19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:10.455006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6ba948fa-c47a-4fe6-8232-e9458d89ba19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:10.467975 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba948fa-c47a-4fe6-8232-e9458d89ba19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:10.469388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba948fa-c47a-4fe6-8232-e9458d89ba19 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:10.480475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1356/2710] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:58:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:58:14.348715 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952c92-6f3d-4b82-93ea-2b94b80a9a13 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:14.349202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952c92-6f3d-4b82-93ea-2b94b80a9a13 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:14.349303 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952c92-6f3d-4b82-93ea-2b94b80a9a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:14.405714 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-eb952c92-6f3d-4b82-93ea-2b94b80a9a13 None None] MFA Rules not processed for user `ad2ea98f75654ec8882650e686135aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:58:14.406914 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eb952c92-6f3d-4b82-93ea-2b94b80a9a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:14.424119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1355/2711] 10.222.0.75 () {58 vars in 967 bytes} [Tue May 17 15:58:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:58:14.476531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba948fa-c47a-4fe6-8232-e9458d89ba19 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:14.497866 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba948fa-c47a-4fe6-8232-e9458d89ba19 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:14.502992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4061a-102c-4b10-bd1e-516286653ae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c811cad8a490891834991a6101984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:14.503633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4061a-102c-4b10-bd1e-516286653ae8 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:14.503918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4061a-102c-4b10-bd1e-516286653ae8 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:14.504203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4061a-102c-4b10-bd1e-516286653ae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:14.512553 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4061a-102c-4b10-bd1e-516286653ae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:14.514167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4061a-102c-4b10-bd1e-516286653ae8 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:14.522695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1357/2712] 10.222.0.75 () {60 vars in 1384 bytes} [Tue May 17 15:58:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 15:58:17.920675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d733b9a-b422-4db8-be2c-3220f6ea118a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:17.921244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d733b9a-b422-4db8-be2c-3220f6ea118a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:17.921244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d733b9a-b422-4db8-be2c-3220f6ea118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:17.941639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9d733b9a-b422-4db8-be2c-3220f6ea118a None None] MFA Rules not processed for user `5a87409628484aa189c7dd44ee74344d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:58:17.943720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d733b9a-b422-4db8-be2c-3220f6ea118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:18.025593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1356/2713] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:58:18.045431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4061a-102c-4b10-bd1e-516286653ae8 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:18.050412 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-32e4061a-102c-4b10-bd1e-516286653ae8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:18.073910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4061a-102c-4b10-bd1e-516286653ae8 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:18.085606 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eac70-41e5-461a-8ece-223a660d0cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:18.086770 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eac70-41e5-461a-8ece-223a660d0cb2 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:18.089729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eac70-41e5-461a-8ece-223a660d0cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:18.090148 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eac70-41e5-461a-8ece-223a660d0cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:18.093462 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3f8eac70-41e5-461a-8ece-223a660d0cb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:18.108779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8eac70-41e5-461a-8ece-223a660d0cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:18.110562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8eac70-41e5-461a-8ece-223a660d0cb2 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:18.120999 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1358/2714] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:58:21.934117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d733b9a-b422-4db8-be2c-3220f6ea118a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:22.013954 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d733b9a-b422-4db8-be2c-3220f6ea118a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:22.019062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:22.020926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:22.021425 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:22.021943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] PATH_INFO: `/v3/users/4b5965b27f1b4ca38680e50363765387` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:22.023569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5965b27f1b4ca38680e50363765387)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:22.025836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:22.095411 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5965b27f1b4ca38680e50363765387'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.114552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5965b27f1b4ca38680e50363765387'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.115366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5965b27f1b4ca38680e50363765387'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.123223 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5965b27f1b4ca38680e50363765387'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.132395 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5965b27f1b4ca38680e50363765387'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.138732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1357/2715] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:58:21 2022] DELETE /identity/v3/users/4b5965b27f1b4ca38680e50363765387 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:58:22.315206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eac70-41e5-461a-8ece-223a660d0cb2 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:22.327785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eac70-41e5-461a-8ece-223a660d0cb2 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:22.383516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:22.384366 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:22.384647 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:22.384950 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] PATH_INFO: `/v3/projects/8636ddd509654ba48dc18dc2837ee0df` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:22.386174 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8636ddd509654ba48dc18dc2837ee0df)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:22.388063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:22.430752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8636ddd509654ba48dc18dc2837ee0df', 'request_id': 'req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.436703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8636ddd509654ba48dc18dc2837ee0df', 'request_id': 'req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.444778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8636ddd509654ba48dc18dc2837ee0df', 'request_id': 'req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.455151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] The token cache is being invalidate because project 8636ddd509654ba48dc18dc2837ee0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:58:22.455436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.456071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.457646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1359/2716] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:58:22 2022] DELETE /identity/v3/projects/8636ddd509654ba48dc18dc2837ee0df => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:58:22.461715 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:22.463123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:22.476066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8b691-9189-4af8-bddb-dd4176883f05 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:22.532719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:22.533591 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:22.533878 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:22.534188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] PATH_INFO: `/v3/users/e013fb6a986f4843b596c81d5bd496b5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:22.535416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e013fb6a986f4843b596c81d5bd496b5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:22.537354 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:22.586423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e013fb6a986f4843b596c81d5bd496b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.598595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e013fb6a986f4843b596c81d5bd496b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.599305 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e013fb6a986f4843b596c81d5bd496b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.606285 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e013fb6a986f4843b596c81d5bd496b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.613386 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c6c6f315-1803-41a7-9ed0-f64ff03262d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e013fb6a986f4843b596c81d5bd496b5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.619757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1358/2717] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 15:58:22 2022] DELETE /identity/v3/users/e013fb6a986f4843b596c81d5bd496b5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:58:22.784201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:22.786228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:22.804480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b7527-eb7f-4f8b-a5a7-5118fc0a9a0a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:22.861735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:22.862617 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:22.862893 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:22.863167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] PATH_INFO: `/v3/projects/64e9d1303dd148d18122eab2b6e330a1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:22.864888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e9d1303dd148d18122eab2b6e330a1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:22.866815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:22.909693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e9d1303dd148d18122eab2b6e330a1', 'request_id': 'req-a3d4dca8-5050-42a9-abfb-2957946dcc25'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.916419 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e9d1303dd148d18122eab2b6e330a1', 'request_id': 'req-a3d4dca8-5050-42a9-abfb-2957946dcc25'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.923505 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e9d1303dd148d18122eab2b6e330a1', 'request_id': 'req-a3d4dca8-5050-42a9-abfb-2957946dcc25'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.934137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] The token cache is being invalidate because project 64e9d1303dd148d18122eab2b6e330a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 15:58:22.934420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.935039 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a3d4dca8-5050-42a9-abfb-2957946dcc25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 15:58:22.936568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1360/2718] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 15:58:22 2022] DELETE /identity/v3/projects/64e9d1303dd148d18122eab2b6e330a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:58:22.941675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031c1f3-e12f-48ef-97a8-ab3d27866f90 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:22.942221 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031c1f3-e12f-48ef-97a8-ab3d27866f90 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:22.942332 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031c1f3-e12f-48ef-97a8-ab3d27866f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:22.959239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6031c1f3-e12f-48ef-97a8-ab3d27866f90 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:58:22.960434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6031c1f3-e12f-48ef-97a8-ab3d27866f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:23.017765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1359/2719] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:58:23.026054 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94612fb2-1594-41d6-966d-e7d991a50999 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:23.026347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94612fb2-1594-41d6-966d-e7d991a50999 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:23.026623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94612fb2-1594-41d6-966d-e7d991a50999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:23.045895 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-94612fb2-1594-41d6-966d-e7d991a50999 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:58:23.047136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-94612fb2-1594-41d6-966d-e7d991a50999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:23.056270 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1361/2720] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:58:23.059366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031c1f3-e12f-48ef-97a8-ab3d27866f90 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:23.069173 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031c1f3-e12f-48ef-97a8-ab3d27866f90 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:23.074291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d91119-10d1-4587-8657-7e9212473972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:23.074940 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d91119-10d1-4587-8657-7e9212473972 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:23.075217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d91119-10d1-4587-8657-7e9212473972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:23.075489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d91119-10d1-4587-8657-7e9212473972 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:23.076216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d91119-10d1-4587-8657-7e9212473972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 15:58:23.076516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d91119-10d1-4587-8657-7e9212473972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:23.078137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d91119-10d1-4587-8657-7e9212473972 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:23.089839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1360/2721] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 15:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 15:58:23.094163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94612fb2-1594-41d6-966d-e7d991a50999 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:23.104635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94612fb2-1594-41d6-966d-e7d991a50999 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:23.109988 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf5d40-9ab9-47b6-a900-dd800f80789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:23.110666 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf5d40-9ab9-47b6-a900-dd800f80789f admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:23.110945 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf5d40-9ab9-47b6-a900-dd800f80789f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:23.111216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf5d40-9ab9-47b6-a900-dd800f80789f admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:23.111905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf5d40-9ab9-47b6-a900-dd800f80789f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:23.113854 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf5d40-9ab9-47b6-a900-dd800f80789f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:23.138038 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1362/2722] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:58:23 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:58:23.142503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d91119-10d1-4587-8657-7e9212473972 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:23.154101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d91119-10d1-4587-8657-7e9212473972 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:23.220437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729a1ea-5383-44c5-aec6-a9ee5f70225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:23.221116 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729a1ea-5383-44c5-aec6-a9ee5f70225e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:23.221401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729a1ea-5383-44c5-aec6-a9ee5f70225e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:23.221677 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729a1ea-5383-44c5-aec6-a9ee5f70225e admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:23.222398 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729a1ea-5383-44c5-aec6-a9ee5f70225e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:23.224935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729a1ea-5383-44c5-aec6-a9ee5f70225e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:23.244947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1361/2723] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:58:23 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:58:23.250708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf5d40-9ab9-47b6-a900-dd800f80789f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:23.264710 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf5d40-9ab9-47b6-a900-dd800f80789f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:23.271052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc1f6-946a-4349-8288-aa5e9f39b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:23.271781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc1f6-946a-4349-8288-aa5e9f39b76e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:23.272068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc1f6-946a-4349-8288-aa5e9f39b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:23.272345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc1f6-946a-4349-8288-aa5e9f39b76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:23.273066 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc1f6-946a-4349-8288-aa5e9f39b76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:23.274719 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc1f6-946a-4349-8288-aa5e9f39b76e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:23.285012 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1363/2724] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:58:23.289593 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729a1ea-5383-44c5-aec6-a9ee5f70225e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:23.299434 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729a1ea-5383-44c5-aec6-a9ee5f70225e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:23.303939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd9b6-0634-46f6-94e6-21ff2b55b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:23.304584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd9b6-0634-46f6-94e6-21ff2b55b4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:23.304868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd9b6-0634-46f6-94e6-21ff2b55b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:23.305144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd9b6-0634-46f6-94e6-21ff2b55b4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:23.305894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd9b6-0634-46f6-94e6-21ff2b55b4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:23.307522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd9b6-0634-46f6-94e6-21ff2b55b4fd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:23.317179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1362/2725] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:58:23.321094 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc1f6-946a-4349-8288-aa5e9f39b76e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:23.330801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc1f6-946a-4349-8288-aa5e9f39b76e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:23.335933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66764a6-dae4-4616-9c9a-a9bd9e5c94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:23.336805 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66764a6-dae4-4616-9c9a-a9bd9e5c94e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:23.337106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66764a6-dae4-4616-9c9a-a9bd9e5c94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:23.337371 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66764a6-dae4-4616-9c9a-a9bd9e5c94e6 admin admin] PATH_INFO: `/v3/projects/fbe368679f4c4d968619ea0e2456c407/users/3df48c5aad0f4cb5aeb7c76d82ab0b4b/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:23.351984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66764a6-dae4-4616-9c9a-a9bd9e5c94e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe368679f4c4d968619ea0e2456c407, user_id=3df48c5aad0f4cb5aeb7c76d82ab0b4b, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:23.354704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66764a6-dae4-4616-9c9a-a9bd9e5c94e6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:23.367147 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1364/2726] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:58:23 2022] PUT /identity/v3/projects/fbe368679f4c4d968619ea0e2456c407/users/3df48c5aad0f4cb5aeb7c76d82ab0b4b/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:58:23.372230 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fb118-4d2d-4d2b-93b0-47612b5cf9d5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:23.372589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fb118-4d2d-4d2b-93b0-47612b5cf9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:23.372950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fb118-4d2d-4d2b-93b0-47612b5cf9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:23.390679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-600fb118-4d2d-4d2b-93b0-47612b5cf9d5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:58:23.391864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-600fb118-4d2d-4d2b-93b0-47612b5cf9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:23.447381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1363/2727] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:58:23.456905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66764a6-dae4-4616-9c9a-a9bd9e5c94e6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:23.459176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c66764a6-dae4-4616-9c9a-a9bd9e5c94e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:23.514608 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66764a6-dae4-4616-9c9a-a9bd9e5c94e6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:23.518279 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad7368-4cdc-4752-8069-323f203ae934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:23.518915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad7368-4cdc-4752-8069-323f203ae934 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:23.519199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad7368-4cdc-4752-8069-323f203ae934 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:23.519477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad7368-4cdc-4752-8069-323f203ae934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:23.528912 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad7368-4cdc-4752-8069-323f203ae934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:23.530386 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad7368-4cdc-4752-8069-323f203ae934 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:23.541144 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1365/2728] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:58:27.635482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d826-c457-49a6-aaaf-91fbb7f6c9fc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:27.636036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d826-c457-49a6-aaaf-91fbb7f6c9fc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:27.636036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d826-c457-49a6-aaaf-91fbb7f6c9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:27.665950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-45c6d826-c457-49a6-aaaf-91fbb7f6c9fc None None] MFA Rules not processed for user `3df48c5aad0f4cb5aeb7c76d82ab0b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:58:27.667684 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-45c6d826-c457-49a6-aaaf-91fbb7f6c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:27.746556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1364/2729] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:58:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:58:27.751151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad7368-4cdc-4752-8069-323f203ae934 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:27.765744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad7368-4cdc-4752-8069-323f203ae934 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:27.771126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5791bd-a3df-485e-9a86-99be971a5d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:27.772168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5791bd-a3df-485e-9a86-99be971a5d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:27.772455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5791bd-a3df-485e-9a86-99be971a5d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:27.772732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5791bd-a3df-485e-9a86-99be971a5d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:27.773418 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5791bd-a3df-485e-9a86-99be971a5d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:27.775372 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5791bd-a3df-485e-9a86-99be971a5d46 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:27.802300 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6d826-c457-49a6-aaaf-91fbb7f6c9fc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:27.802680 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1366/2730] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 15:58:27 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 15:58:27.806952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5791bd-a3df-485e-9a86-99be971a5d46 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:27.813888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6d826-c457-49a6-aaaf-91fbb7f6c9fc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:27.866715 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65ffb6-00e5-43c6-a955-806e6aaa2130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:27.867681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65ffb6-00e5-43c6-a955-806e6aaa2130 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:27.868209 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65ffb6-00e5-43c6-a955-806e6aaa2130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:27.868557 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65ffb6-00e5-43c6-a955-806e6aaa2130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:27.870524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dc65ffb6-00e5-43c6-a955-806e6aaa2130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:27.872989 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5791bd-a3df-485e-9a86-99be971a5d46 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:27.877767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dee8b-17af-4172-815d-cc96e0d30578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:27.878679 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dee8b-17af-4172-815d-cc96e0d30578 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:27.879590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dee8b-17af-4172-815d-cc96e0d30578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:27.879929 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dee8b-17af-4172-815d-cc96e0d30578 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:27.880691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dee8b-17af-4172-815d-cc96e0d30578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:27.881540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65ffb6-00e5-43c6-a955-806e6aaa2130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:27.882858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dee8b-17af-4172-815d-cc96e0d30578 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:27.883190 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65ffb6-00e5-43c6-a955-806e6aaa2130 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:27.892167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1365/2731] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:58:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:58:27.910896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1367/2732] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 15:58:27 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 15:58:27.913705 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65ffb6-00e5-43c6-a955-806e6aaa2130 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:27.927716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65ffb6-00e5-43c6-a955-806e6aaa2130 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:27.936034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead14882-fd27-4725-99de-5c0cf5862008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:27.936735 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead14882-fd27-4725-99de-5c0cf5862008 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:27.936983 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead14882-fd27-4725-99de-5c0cf5862008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:27.937453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead14882-fd27-4725-99de-5c0cf5862008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:27.938229 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead14882-fd27-4725-99de-5c0cf5862008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:27.940499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead14882-fd27-4725-99de-5c0cf5862008 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:27.952084 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1366/2733] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:58:27.956385 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dee8b-17af-4172-815d-cc96e0d30578 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:27.966952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dee8b-17af-4172-815d-cc96e0d30578 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:27.972195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9fe08-d48c-450d-aa73-b78e6da0e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:27.973632 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9fe08-d48c-450d-aa73-b78e6da0e522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:27.973919 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9fe08-d48c-450d-aa73-b78e6da0e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:27.974237 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9fe08-d48c-450d-aa73-b78e6da0e522 admin admin] PATH_INFO: `/v3/projects/aa2522a5f92c4818bd9129ed97f5e6bb/users/b46cc9c6d3334842b68dcda52e4ceaec/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:27.990858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9fe08-d48c-450d-aa73-b78e6da0e522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2522a5f92c4818bd9129ed97f5e6bb, user_id=b46cc9c6d3334842b68dcda52e4ceaec, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:27.993579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9fe08-d48c-450d-aa73-b78e6da0e522 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:28.007472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1368/2734] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:58:27 2022] PUT /identity/v3/projects/aa2522a5f92c4818bd9129ed97f5e6bb/users/b46cc9c6d3334842b68dcda52e4ceaec/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:58:28.011380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead14882-fd27-4725-99de-5c0cf5862008 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:28.021329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead14882-fd27-4725-99de-5c0cf5862008 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:28.077363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362d826-c913-4ea4-b8aa-66f31778f74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:28.078065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362d826-c913-4ea4-b8aa-66f31778f74f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:28.078352 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362d826-c913-4ea4-b8aa-66f31778f74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:28.078632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362d826-c913-4ea4-b8aa-66f31778f74f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:28.079355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362d826-c913-4ea4-b8aa-66f31778f74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:28.080935 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362d826-c913-4ea4-b8aa-66f31778f74f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:28.090913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1367/2735] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 15:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 15:58:28.095109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9fe08-d48c-450d-aa73-b78e6da0e522 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:28.106370 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9fe08-d48c-450d-aa73-b78e6da0e522 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:28.111190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf4cc2-36f1-47c0-8b27-60d035d8faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:28.112080 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf4cc2-36f1-47c0-8b27-60d035d8faf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:28.112452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf4cc2-36f1-47c0-8b27-60d035d8faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:28.112630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf4cc2-36f1-47c0-8b27-60d035d8faf2 admin admin] PATH_INFO: `/v3/projects/aa2522a5f92c4818bd9129ed97f5e6bb/users/b46cc9c6d3334842b68dcda52e4ceaec/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:28.115354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf4cc2-36f1-47c0-8b27-60d035d8faf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2522a5f92c4818bd9129ed97f5e6bb, user_id=b46cc9c6d3334842b68dcda52e4ceaec, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:28.118026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf4cc2-36f1-47c0-8b27-60d035d8faf2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:28.129076 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1369/2736] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 15:58:28 2022] PUT /identity/v3/projects/aa2522a5f92c4818bd9129ed97f5e6bb/users/b46cc9c6d3334842b68dcda52e4ceaec/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 15:58:32.357517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362d826-c913-4ea4-b8aa-66f31778f74f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:32.362355 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a362d826-c913-4ea4-b8aa-66f31778f74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:32.507921 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362d826-c913-4ea4-b8aa-66f31778f74f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:32.637608 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:32.638316 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:32.638596 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:32.638870 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:32.641025 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:32.664502 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:32.668941 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:32.686221 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1368/2737] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:58:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:58:33.958242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67250a-d81f-403a-a544-7aacc9c8652a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:33.958739 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67250a-d81f-403a-a544-7aacc9c8652a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:33.958849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67250a-d81f-403a-a544-7aacc9c8652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:33.984905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ec67250a-d81f-403a-a544-7aacc9c8652a None None] MFA Rules not processed for user `b46cc9c6d3334842b68dcda52e4ceaec`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:58:33.986059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ec67250a-d81f-403a-a544-7aacc9c8652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:34.051857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1370/2738] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:58:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:58:34.065427 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:58:34.067903 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:34.081393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2924d0-779f-4ae0-a12c-befc7b318659 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:58:34.087660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046882a-024d-4631-8c25-93293d33af06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:58:34.088225 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046882a-024d-4631-8c25-93293d33af06 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:34.088504 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046882a-024d-4631-8c25-93293d33af06 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:34.088773 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046882a-024d-4631-8c25-93293d33af06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:34.142342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046882a-024d-4631-8c25-93293d33af06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:58:34.144000 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046882a-024d-4631-8c25-93293d33af06 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:58:34.153761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1369/2739] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:58:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:58:58.661885 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe87a8-bc32-48fc-9164-991ee1717d9b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:58:58.662432 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe87a8-bc32-48fc-9164-991ee1717d9b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:58:58.662535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe87a8-bc32-48fc-9164-991ee1717d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:58:58.679379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fafe87a8-bc32-48fc-9164-991ee1717d9b None None] MFA Rules not processed for user `3df48c5aad0f4cb5aeb7c76d82ab0b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 15:58:58.680545 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fafe87a8-bc32-48fc-9164-991ee1717d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:58:58.687732 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1371/2740] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 15:59:16.501924 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046882a-024d-4631-8c25-93293d33af06 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:59:16.503400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6046882a-024d-4631-8c25-93293d33af06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:59:16.557589 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046882a-024d-4631-8c25-93293d33af06 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:59:16.561262 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5773d28-7134-41e0-a2d8-6b5d81e6371d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:59:16.561836 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773d28-7134-41e0-a2d8-6b5d81e6371d service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:59:16.562218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773d28-7134-41e0-a2d8-6b5d81e6371d service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:59:16.562499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773d28-7134-41e0-a2d8-6b5d81e6371d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:59:16.571206 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5773d28-7134-41e0-a2d8-6b5d81e6371d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:59:16.572638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5773d28-7134-41e0-a2d8-6b5d81e6371d service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:59:16.581715 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1370/2741] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:16.664960 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe87a8-bc32-48fc-9164-991ee1717d9b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:16.674518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe87a8-bc32-48fc-9164-991ee1717d9b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:16.678136 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b321-250f-40d9-8afd-d5be9c59c274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:16.678800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b321-250f-40d9-8afd-d5be9c59c274 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:16.679087 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b321-250f-40d9-8afd-d5be9c59c274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:16.679367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b321-250f-40d9-8afd-d5be9c59c274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:16.681612 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4798b321-250f-40d9-8afd-d5be9c59c274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:16.741286 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798b321-250f-40d9-8afd-d5be9c59c274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:16.743763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798b321-250f-40d9-8afd-d5be9c59c274 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:16.753181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1372/2742] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:19.801858 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5773d28-7134-41e0-a2d8-6b5d81e6371d service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:19.804272 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b5773d28-7134-41e0-a2d8-6b5d81e6371d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:19.820299 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5773d28-7134-41e0-a2d8-6b5d81e6371d service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:19.825076 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:19.825951 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:19.826266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:19.826543 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] PATH_INFO: `/v3/users/5a87409628484aa189c7dd44ee74344d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:19.827892 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a87409628484aa189c7dd44ee74344d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:19.829868 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:19.881313 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a87409628484aa189c7dd44ee74344d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:19.894720 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a87409628484aa189c7dd44ee74344d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:19.895406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a87409628484aa189c7dd44ee74344d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:19.903536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a87409628484aa189c7dd44ee74344d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:19.911641 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-089a8706-ff2c-4989-8b7d-b0b49188b120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a87409628484aa189c7dd44ee74344d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:19.917803 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1371/2743] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:19 2022] DELETE /identity/v3/users/5a87409628484aa189c7dd44ee74344d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:20.087332 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b321-250f-40d9-8afd-d5be9c59c274 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:20.102814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b321-250f-40d9-8afd-d5be9c59c274 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:20.162086 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:20.163452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.163741 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.164019 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] PATH_INFO: `/v3/projects/fabeead7b416455b8d93f9531f895ba4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.165263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabeead7b416455b8d93f9531f895ba4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:20.167251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:20.211396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabeead7b416455b8d93f9531f895ba4', 'request_id': 'req-c76cd29a-49cf-4091-b126-66900b5e51f3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:20.217718 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabeead7b416455b8d93f9531f895ba4', 'request_id': 'req-c76cd29a-49cf-4091-b126-66900b5e51f3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:20.224403 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabeead7b416455b8d93f9531f895ba4', 'request_id': 'req-c76cd29a-49cf-4091-b126-66900b5e51f3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:20.234301 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] The token cache is being invalidate because project fabeead7b416455b8d93f9531f895ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:20.234580 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:20.235305 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c76cd29a-49cf-4091-b126-66900b5e51f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:20.236884 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1373/2744] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:20 2022] DELETE /identity/v3/projects/fabeead7b416455b8d93f9531f895ba4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:20.241750 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bca18-a0bb-4571-b0a2-6ba4716c2518 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.242073 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bca18-a0bb-4571-b0a2-6ba4716c2518 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.242882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bca18-a0bb-4571-b0a2-6ba4716c2518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.260466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b34bca18-a0bb-4571-b0a2-6ba4716c2518 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:20.261685 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b34bca18-a0bb-4571-b0a2-6ba4716c2518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:20.324254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1372/2745] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:20.332543 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ac1ed-ac06-4214-b11c-4ed52be26f70 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.332830 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ac1ed-ac06-4214-b11c-4ed52be26f70 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.333108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ac1ed-ac06-4214-b11c-4ed52be26f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.350860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5e2ac1ed-ac06-4214-b11c-4ed52be26f70 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:20.352083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5e2ac1ed-ac06-4214-b11c-4ed52be26f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:20.360121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1374/2746] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:20.364356 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bca18-a0bb-4571-b0a2-6ba4716c2518 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:20.378244 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bca18-a0bb-4571-b0a2-6ba4716c2518 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:20.384157 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f2851-4d5b-40e5-8f06-bd4255c11256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:20.384817 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f2851-4d5b-40e5-8f06-bd4255c11256 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.385099 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f2851-4d5b-40e5-8f06-bd4255c11256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.385375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f2851-4d5b-40e5-8f06-bd4255c11256 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.386134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f2851-4d5b-40e5-8f06-bd4255c11256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:00:20.386442 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f2851-4d5b-40e5-8f06-bd4255c11256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:20.388031 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f2851-4d5b-40e5-8f06-bd4255c11256 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:20.399657 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1373/2747] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 16:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:00:20.403910 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ac1ed-ac06-4214-b11c-4ed52be26f70 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:20.413102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ac1ed-ac06-4214-b11c-4ed52be26f70 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:20.417768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c38de7-ce93-4ef0-9dac-c76a8db38f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:20.418455 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c38de7-ce93-4ef0-9dac-c76a8db38f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.418738 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c38de7-ce93-4ef0-9dac-c76a8db38f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.419014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c38de7-ce93-4ef0-9dac-c76a8db38f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.419704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c38de7-ce93-4ef0-9dac-c76a8db38f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:20.421604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c38de7-ce93-4ef0-9dac-c76a8db38f59 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:20.456648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1375/2748] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:20 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:20.460839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f2851-4d5b-40e5-8f06-bd4255c11256 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:20.471383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f2851-4d5b-40e5-8f06-bd4255c11256 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:20.525798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af83b8-6552-4437-98f3-0e85fe2d5c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:20.526482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af83b8-6552-4437-98f3-0e85fe2d5c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.526765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af83b8-6552-4437-98f3-0e85fe2d5c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.527039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af83b8-6552-4437-98f3-0e85fe2d5c18 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.527726 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af83b8-6552-4437-98f3-0e85fe2d5c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:20.529656 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af83b8-6552-4437-98f3-0e85fe2d5c18 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:20.548379 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1374/2749] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:20 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:00:20.552787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c38de7-ce93-4ef0-9dac-c76a8db38f59 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:20.563343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c38de7-ce93-4ef0-9dac-c76a8db38f59 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:20.568538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c627e4-c243-4a65-b2ac-137c3a81d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:20.569199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c627e4-c243-4a65-b2ac-137c3a81d4ac admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.569484 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c627e4-c243-4a65-b2ac-137c3a81d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.569760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c627e4-c243-4a65-b2ac-137c3a81d4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.571108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c627e4-c243-4a65-b2ac-137c3a81d4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:20.572800 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c627e4-c243-4a65-b2ac-137c3a81d4ac admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:20.582589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1376/2750] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:20.586519 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af83b8-6552-4437-98f3-0e85fe2d5c18 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:20.595999 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af83b8-6552-4437-98f3-0e85fe2d5c18 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:20.600553 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e26c6a-cad4-480b-a525-a1c7c8ce1c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:20.601185 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e26c6a-cad4-480b-a525-a1c7c8ce1c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.601463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e26c6a-cad4-480b-a525-a1c7c8ce1c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.602249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e26c6a-cad4-480b-a525-a1c7c8ce1c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.602962 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e26c6a-cad4-480b-a525-a1c7c8ce1c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:20.604523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e26c6a-cad4-480b-a525-a1c7c8ce1c30 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:20.614211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1375/2751] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:20.618602 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c627e4-c243-4a65-b2ac-137c3a81d4ac admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:20.628566 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c627e4-c243-4a65-b2ac-137c3a81d4ac admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:20.633198 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577167d1-803c-4679-a87c-1abdc275d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:20.634090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577167d1-803c-4679-a87c-1abdc275d339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.634379 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577167d1-803c-4679-a87c-1abdc275d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.634660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577167d1-803c-4679-a87c-1abdc275d339 admin admin] PATH_INFO: `/v3/projects/0193131753454d8689027a7401ac5617/users/30197f373c414492848c5545646272fd/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.648530 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577167d1-803c-4679-a87c-1abdc275d339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0193131753454d8689027a7401ac5617, user_id=30197f373c414492848c5545646272fd, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:20.651267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577167d1-803c-4679-a87c-1abdc275d339 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:20.663590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1377/2752] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:20 2022] PUT /identity/v3/projects/0193131753454d8689027a7401ac5617/users/30197f373c414492848c5545646272fd/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:20.673879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae84ba-d4c6-4bb5-9543-9933a50a3f03 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.674250 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae84ba-d4c6-4bb5-9543-9933a50a3f03 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.674531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae84ba-d4c6-4bb5-9543-9933a50a3f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.701289 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dbae84ba-d4c6-4bb5-9543-9933a50a3f03 None None] MFA Rules not processed for user `30197f373c414492848c5545646272fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:20.702567 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dbae84ba-d4c6-4bb5-9543-9933a50a3f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:20.762823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1376/2753] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:20.774388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577167d1-803c-4679-a87c-1abdc275d339 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:20.776102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-577167d1-803c-4679-a87c-1abdc275d339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:20.847529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577167d1-803c-4679-a87c-1abdc275d339 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:20.853102 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9383e-0a29-42b8-8352-5e4bd71294f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:20.853740 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9383e-0a29-42b8-8352-5e4bd71294f7 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:20.854041 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9383e-0a29-42b8-8352-5e4bd71294f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:20.854333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9383e-0a29-42b8-8352-5e4bd71294f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:20.862204 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9383e-0a29-42b8-8352-5e4bd71294f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:20.863764 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9383e-0a29-42b8-8352-5e4bd71294f7 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:20.872274 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1378/2754] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:21.069769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae84ba-d4c6-4bb5-9543-9933a50a3f03 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:21.131351 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae84ba-d4c6-4bb5-9543-9933a50a3f03 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:21.138130 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:21.139470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:21.139470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:21.139660 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] PATH_INFO: `/v3/users/30197f373c414492848c5545646272fd` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:21.142165 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30197f373c414492848c5545646272fd)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:21.143153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:21.190418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30197f373c414492848c5545646272fd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.202378 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30197f373c414492848c5545646272fd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.203056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30197f373c414492848c5545646272fd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.209451 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30197f373c414492848c5545646272fd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.217736 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30197f373c414492848c5545646272fd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.223482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1377/2755] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:21 2022] DELETE /identity/v3/users/30197f373c414492848c5545646272fd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:21.227927 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae60cf3-9eeb-4acb-b2c7-dcb095cad991 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:21.228413 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae60cf3-9eeb-4acb-b2c7-dcb095cad991 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:21.228523 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae60cf3-9eeb-4acb-b2c7-dcb095cad991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:21.245803 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6ae60cf3-9eeb-4acb-b2c7-dcb095cad991 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:21.247029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6ae60cf3-9eeb-4acb-b2c7-dcb095cad991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:21.307568 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1379/2756] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:21.318611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:21.320010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:21.375131 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f069c4-84a4-4e81-8ebc-a212e6036622 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:21.378730 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a2c18-c91d-4008-9cbe-2c036193e257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:21.379363 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a2c18-c91d-4008-9cbe-2c036193e257 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:21.379643 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a2c18-c91d-4008-9cbe-2c036193e257 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:21.379916 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a2c18-c91d-4008-9cbe-2c036193e257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:21.389112 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a2c18-c91d-4008-9cbe-2c036193e257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:21.390546 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a2c18-c91d-4008-9cbe-2c036193e257 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:21.400081 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1378/2757] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:21.653974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae60cf3-9eeb-4acb-b2c7-dcb095cad991 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:21.655345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6ae60cf3-9eeb-4acb-b2c7-dcb095cad991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:21.668252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae60cf3-9eeb-4acb-b2c7-dcb095cad991 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:21.674598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:21.675488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:21.675841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:21.676033 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] PATH_INFO: `/v3/projects/0193131753454d8689027a7401ac5617` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:21.677253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0193131753454d8689027a7401ac5617)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:21.681018 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:21.727779 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0193131753454d8689027a7401ac5617', 'request_id': 'req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.733943 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0193131753454d8689027a7401ac5617', 'request_id': 'req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.741812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0193131753454d8689027a7401ac5617', 'request_id': 'req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.752336 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] The token cache is being invalidate because project 0193131753454d8689027a7401ac5617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:21.752620 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.753263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2eafe446-fbcb-4931-9a5e-73a55c5f19cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:21.754808 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1380/2758] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:21 2022] DELETE /identity/v3/projects/0193131753454d8689027a7401ac5617 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:21.760481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f01179-f9a1-4e89-87e9-9cae70f5c657 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:21.760728 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f01179-f9a1-4e89-87e9-9cae70f5c657 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:21.761084 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f01179-f9a1-4e89-87e9-9cae70f5c657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:21.779469 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f7f01179-f9a1-4e89-87e9-9cae70f5c657 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:21.780670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f7f01179-f9a1-4e89-87e9-9cae70f5c657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:21.838651 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1379/2759] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:21.846743 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39db18-dd4c-4362-92a4-3becf92416b5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:21.847059 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39db18-dd4c-4362-92a4-3becf92416b5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:21.847339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39db18-dd4c-4362-92a4-3becf92416b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:21.865914 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7b39db18-dd4c-4362-92a4-3becf92416b5 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:21.867133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7b39db18-dd4c-4362-92a4-3becf92416b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:21.874865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1381/2760] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:21.879065 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f01179-f9a1-4e89-87e9-9cae70f5c657 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:21.888618 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f01179-f9a1-4e89-87e9-9cae70f5c657 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:21.893148 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d558d-e4eb-4fa9-8f29-aa5163fbb686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:21.893797 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d558d-e4eb-4fa9-8f29-aa5163fbb686 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:21.894117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d558d-e4eb-4fa9-8f29-aa5163fbb686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:21.894400 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d558d-e4eb-4fa9-8f29-aa5163fbb686 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:21.895127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d558d-e4eb-4fa9-8f29-aa5163fbb686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:00:21.895437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d558d-e4eb-4fa9-8f29-aa5163fbb686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:21.897040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d558d-e4eb-4fa9-8f29-aa5163fbb686 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:21.908986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1380/2761] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 16:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:00:21.913196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39db18-dd4c-4362-92a4-3becf92416b5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:21.923168 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39db18-dd4c-4362-92a4-3becf92416b5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:21.927691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cbe4b-2699-4971-ae5a-f026f96d49f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:21.928367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cbe4b-2699-4971-ae5a-f026f96d49f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:21.928648 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cbe4b-2699-4971-ae5a-f026f96d49f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:21.928948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cbe4b-2699-4971-ae5a-f026f96d49f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:21.929674 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cbe4b-2699-4971-ae5a-f026f96d49f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:21.931618 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cbe4b-2699-4971-ae5a-f026f96d49f8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:21.955691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1382/2762] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:21 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:21.959860 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d558d-e4eb-4fa9-8f29-aa5163fbb686 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:21.970247 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d558d-e4eb-4fa9-8f29-aa5163fbb686 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.022290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed9025-9960-4582-87ff-856e78d801e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.022936 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed9025-9960-4582-87ff-856e78d801e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.023216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed9025-9960-4582-87ff-856e78d801e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.023988 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed9025-9960-4582-87ff-856e78d801e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.024669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed9025-9960-4582-87ff-856e78d801e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.026578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed9025-9960-4582-87ff-856e78d801e5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.046503 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1381/2763] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:21 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:22.049948 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cbe4b-2699-4971-ae5a-f026f96d49f8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.060263 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cbe4b-2699-4971-ae5a-f026f96d49f8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.064836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a4b21-859b-4003-85dd-92358df325ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.065533 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a4b21-859b-4003-85dd-92358df325ea admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.065813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a4b21-859b-4003-85dd-92358df325ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.066120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a4b21-859b-4003-85dd-92358df325ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.066831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a4b21-859b-4003-85dd-92358df325ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.068421 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a4b21-859b-4003-85dd-92358df325ea admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.080258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1383/2764] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:22.084188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed9025-9960-4582-87ff-856e78d801e5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.094476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed9025-9960-4582-87ff-856e78d801e5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.099083 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f95d78-37be-4f78-bc3b-a04cbc2e4822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.099727 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95d78-37be-4f78-bc3b-a04cbc2e4822 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.100010 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95d78-37be-4f78-bc3b-a04cbc2e4822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.100287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95d78-37be-4f78-bc3b-a04cbc2e4822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.101011 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f95d78-37be-4f78-bc3b-a04cbc2e4822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.102646 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f95d78-37be-4f78-bc3b-a04cbc2e4822 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.114276 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1382/2765] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:22.118130 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a4b21-859b-4003-85dd-92358df325ea admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.127773 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a4b21-859b-4003-85dd-92358df325ea admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.132388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fae19-d4c1-4cec-86ee-af8f70d1ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.133736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fae19-d4c1-4cec-86ee-af8f70d1ca4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.134045 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fae19-d4c1-4cec-86ee-af8f70d1ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.134358 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fae19-d4c1-4cec-86ee-af8f70d1ca4d admin admin] PATH_INFO: `/v3/projects/b8d3276bc90e431bbf1ddfb901a9aed2/users/5027ceb953954e3da6be1a050d2e6b05/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.153308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fae19-d4c1-4cec-86ee-af8f70d1ca4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d3276bc90e431bbf1ddfb901a9aed2, user_id=5027ceb953954e3da6be1a050d2e6b05, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.155992 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fae19-d4c1-4cec-86ee-af8f70d1ca4d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.173246 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1384/2766] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:22 2022] PUT /identity/v3/projects/b8d3276bc90e431bbf1ddfb901a9aed2/users/5027ceb953954e3da6be1a050d2e6b05/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:22.184619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03b17c-723e-43bb-972a-c3d5e48fa8ae None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.184912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03b17c-723e-43bb-972a-c3d5e48fa8ae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.185217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03b17c-723e-43bb-972a-c3d5e48fa8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.210876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-df03b17c-723e-43bb-972a-c3d5e48fa8ae None None] MFA Rules not processed for user `5027ceb953954e3da6be1a050d2e6b05`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:22.212631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-df03b17c-723e-43bb-972a-c3d5e48fa8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:22.273348 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1383/2767] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:22.278389 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fae19-d4c1-4cec-86ee-af8f70d1ca4d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.336789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fae19-d4c1-4cec-86ee-af8f70d1ca4d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.341409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84662-4221-4f8d-b697-6aa23d81dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.342079 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84662-4221-4f8d-b697-6aa23d81dd22 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.342373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84662-4221-4f8d-b697-6aa23d81dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.342640 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84662-4221-4f8d-b697-6aa23d81dd22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.343310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb84662-4221-4f8d-b697-6aa23d81dd22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.345201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb84662-4221-4f8d-b697-6aa23d81dd22 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.370061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1385/2768] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:22 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:22.373918 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03b17c-723e-43bb-972a-c3d5e48fa8ae None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.384653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03b17c-723e-43bb-972a-c3d5e48fa8ae None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.437574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b534ca-daf9-44a1-b52f-a008b8886b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.438186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b534ca-daf9-44a1-b52f-a008b8886b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.438468 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b534ca-daf9-44a1-b52f-a008b8886b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.438739 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b534ca-daf9-44a1-b52f-a008b8886b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.439419 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b534ca-daf9-44a1-b52f-a008b8886b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.441366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b534ca-daf9-44a1-b52f-a008b8886b7d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.461639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1384/2769] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:22 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:00:22.465584 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84662-4221-4f8d-b697-6aa23d81dd22 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.476205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84662-4221-4f8d-b697-6aa23d81dd22 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.480753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a9d92-e510-4f90-a67e-e811b98e22d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.481402 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a9d92-e510-4f90-a67e-e811b98e22d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.481933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a9d92-e510-4f90-a67e-e811b98e22d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.482239 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a9d92-e510-4f90-a67e-e811b98e22d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.482952 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a9d92-e510-4f90-a67e-e811b98e22d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.484531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a9d92-e510-4f90-a67e-e811b98e22d9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.495452 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1386/2770] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:22.499696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b534ca-daf9-44a1-b52f-a008b8886b7d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.510103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b534ca-daf9-44a1-b52f-a008b8886b7d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.514977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d7f63-4ab5-4f2f-a6f1-6597f136a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.515869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d7f63-4ab5-4f2f-a6f1-6597f136a2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.516137 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d7f63-4ab5-4f2f-a6f1-6597f136a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.516410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d7f63-4ab5-4f2f-a6f1-6597f136a2bc admin admin] PATH_INFO: `/v3/projects/135604d26a8f4fc787bb2c709332ca48/users/8ddcc613790449f99cbd2bfe9debc881/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.530655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d7f63-4ab5-4f2f-a6f1-6597f136a2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=135604d26a8f4fc787bb2c709332ca48, user_id=8ddcc613790449f99cbd2bfe9debc881, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.533306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d7f63-4ab5-4f2f-a6f1-6597f136a2bc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.545813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1385/2771] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:22 2022] PUT /identity/v3/projects/135604d26a8f4fc787bb2c709332ca48/users/8ddcc613790449f99cbd2bfe9debc881/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 16:00:22.549793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a9d92-e510-4f90-a67e-e811b98e22d9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.560199 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a9d92-e510-4f90-a67e-e811b98e22d9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.614078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7882b-b3c6-461b-9a17-6468b80bdf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.614735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7882b-b3c6-461b-9a17-6468b80bdf92 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.615020 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7882b-b3c6-461b-9a17-6468b80bdf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.615296 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7882b-b3c6-461b-9a17-6468b80bdf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.616014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7882b-b3c6-461b-9a17-6468b80bdf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.618129 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7882b-b3c6-461b-9a17-6468b80bdf92 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.627362 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1387/2772] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:22.631477 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d7f63-4ab5-4f2f-a6f1-6597f136a2bc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.641879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d7f63-4ab5-4f2f-a6f1-6597f136a2bc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.646435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a795b0-540c-4e9c-8965-37220112ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.647293 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a795b0-540c-4e9c-8965-37220112ddff admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.647569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a795b0-540c-4e9c-8965-37220112ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.647839 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a795b0-540c-4e9c-8965-37220112ddff admin admin] PATH_INFO: `/v3/projects/135604d26a8f4fc787bb2c709332ca48/users/8ddcc613790449f99cbd2bfe9debc881/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.649762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a795b0-540c-4e9c-8965-37220112ddff admin admin] RBAC: Authorizing `identity:create_grant(project_id=135604d26a8f4fc787bb2c709332ca48, user_id=8ddcc613790449f99cbd2bfe9debc881, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.652387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a795b0-540c-4e9c-8965-37220112ddff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.662290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1386/2773] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:22 2022] PUT /identity/v3/projects/135604d26a8f4fc787bb2c709332ca48/users/8ddcc613790449f99cbd2bfe9debc881/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:22.673156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22785c1a-10b1-4e2e-b8b5-bbf1db16d07c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.673450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22785c1a-10b1-4e2e-b8b5-bbf1db16d07c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.673896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22785c1a-10b1-4e2e-b8b5-bbf1db16d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.702056 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-22785c1a-10b1-4e2e-b8b5-bbf1db16d07c None None] MFA Rules not processed for user `8ddcc613790449f99cbd2bfe9debc881`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:22.703193 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-22785c1a-10b1-4e2e-b8b5-bbf1db16d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:22.766448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1388/2774] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:22.777520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a795b0-540c-4e9c-8965-37220112ddff admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:22.779252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-51a795b0-540c-4e9c-8965-37220112ddff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:22.854295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a795b0-540c-4e9c-8965-37220112ddff admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:22.858146 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73402044-109c-4c99-9944-eb144bbf081f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:22.858771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73402044-109c-4c99-9944-eb144bbf081f service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:22.859049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73402044-109c-4c99-9944-eb144bbf081f service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:22.859317 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73402044-109c-4c99-9944-eb144bbf081f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:22.868536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73402044-109c-4c99-9944-eb144bbf081f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:22.869944 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73402044-109c-4c99-9944-eb144bbf081f service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:22.879026 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1387/2775] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:23.233961 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22785c1a-10b1-4e2e-b8b5-bbf1db16d07c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:23.294918 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22785c1a-10b1-4e2e-b8b5-bbf1db16d07c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:23.299435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:23.300293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:23.300576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:23.300849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] PATH_INFO: `/v3/users/5027ceb953954e3da6be1a050d2e6b05` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:23.302070 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5027ceb953954e3da6be1a050d2e6b05)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:23.303994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:23.346851 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5027ceb953954e3da6be1a050d2e6b05'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.358315 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5027ceb953954e3da6be1a050d2e6b05'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.358984 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5027ceb953954e3da6be1a050d2e6b05'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.359586 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5027ceb953954e3da6be1a050d2e6b05'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.366201 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5027ceb953954e3da6be1a050d2e6b05'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.380085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1389/2776] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:23 2022] DELETE /identity/v3/users/5027ceb953954e3da6be1a050d2e6b05 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:23.385329 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279804d-f15b-47c6-9a6b-db5cfd58d4df None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:23.385813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279804d-f15b-47c6-9a6b-db5cfd58d4df None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:23.385914 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279804d-f15b-47c6-9a6b-db5cfd58d4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:23.402762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7279804d-f15b-47c6-9a6b-db5cfd58d4df None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:23.403952 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7279804d-f15b-47c6-9a6b-db5cfd58d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:23.459993 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1388/2777] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:23.469903 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:23.471299 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:23.525789 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5a5a1-16f5-407d-9776-60c89aac55fe admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:23.529598 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84293df2-0ace-4123-aef6-907b6688e402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:23.530272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84293df2-0ace-4123-aef6-907b6688e402 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:23.530557 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84293df2-0ace-4123-aef6-907b6688e402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:23.530832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84293df2-0ace-4123-aef6-907b6688e402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:23.539841 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84293df2-0ace-4123-aef6-907b6688e402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:23.541261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84293df2-0ace-4123-aef6-907b6688e402 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:23.550498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1390/2778] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:23.804373 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279804d-f15b-47c6-9a6b-db5cfd58d4df None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:23.806447 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7279804d-f15b-47c6-9a6b-db5cfd58d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:23.820183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279804d-f15b-47c6-9a6b-db5cfd58d4df None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:23.825457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:23.826418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:23.826819 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:23.827100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] PATH_INFO: `/v3/projects/b8d3276bc90e431bbf1ddfb901a9aed2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:23.828297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d3276bc90e431bbf1ddfb901a9aed2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:23.830228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:23.876245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d3276bc90e431bbf1ddfb901a9aed2', 'request_id': 'req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.882297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d3276bc90e431bbf1ddfb901a9aed2', 'request_id': 'req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.889634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d3276bc90e431bbf1ddfb901a9aed2', 'request_id': 'req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.899476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] The token cache is being invalidate because project b8d3276bc90e431bbf1ddfb901a9aed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:23.899761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.900376 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:23.901888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1389/2779] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:23 2022] DELETE /identity/v3/projects/b8d3276bc90e431bbf1ddfb901a9aed2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:23.905813 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84293df2-0ace-4123-aef6-907b6688e402 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:23.915790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84293df2-0ace-4123-aef6-907b6688e402 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:23.969391 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:23.970273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:23.970555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:23.970828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] PATH_INFO: `/v3/users/8ddcc613790449f99cbd2bfe9debc881` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:23.972047 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddcc613790449f99cbd2bfe9debc881)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:23.973936 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:24.017767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddcc613790449f99cbd2bfe9debc881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.029587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddcc613790449f99cbd2bfe9debc881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.030266 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddcc613790449f99cbd2bfe9debc881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.030872 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddcc613790449f99cbd2bfe9debc881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.038228 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05ec3961-aaea-42b6-a70f-8e3e692c8edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddcc613790449f99cbd2bfe9debc881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.050786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1391/2780] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:23 2022] DELETE /identity/v3/users/8ddcc613790449f99cbd2bfe9debc881 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:24.314716 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:24.316167 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:24.331746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb053e07-f47d-4ed2-a380-52cdcd87b7c1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:24.389482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:24.390383 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.390670 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.390945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] PATH_INFO: `/v3/projects/135604d26a8f4fc787bb2c709332ca48` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.392123 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=135604d26a8f4fc787bb2c709332ca48)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:24.394042 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:24.436821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135604d26a8f4fc787bb2c709332ca48', 'request_id': 'req-a513b438-8e37-4a4c-a278-80c3e69681ce'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.442635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135604d26a8f4fc787bb2c709332ca48', 'request_id': 'req-a513b438-8e37-4a4c-a278-80c3e69681ce'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.449932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135604d26a8f4fc787bb2c709332ca48', 'request_id': 'req-a513b438-8e37-4a4c-a278-80c3e69681ce'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.459653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] The token cache is being invalidate because project 135604d26a8f4fc787bb2c709332ca48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:24.459942 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.460582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a513b438-8e37-4a4c-a278-80c3e69681ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:24.462255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1390/2781] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:24 2022] DELETE /identity/v3/projects/135604d26a8f4fc787bb2c709332ca48 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:24.467746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b80bf-067f-46c3-aebc-499f71639589 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.468242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b80bf-067f-46c3-aebc-499f71639589 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.468343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b80bf-067f-46c3-aebc-499f71639589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.488630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-141b80bf-067f-46c3-aebc-499f71639589 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:24.489837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-141b80bf-067f-46c3-aebc-499f71639589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:24.553112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1392/2782] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:24.562709 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9e332-2d19-4924-93eb-2aa9e66829d0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.562932 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9e332-2d19-4924-93eb-2aa9e66829d0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.563210 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9e332-2d19-4924-93eb-2aa9e66829d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.581070 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c5e9e332-2d19-4924-93eb-2aa9e66829d0 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:24.582301 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c5e9e332-2d19-4924-93eb-2aa9e66829d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:24.590132 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1391/2783] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:24.594275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b80bf-067f-46c3-aebc-499f71639589 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:24.604119 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b80bf-067f-46c3-aebc-499f71639589 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:24.608832 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20162-0719-4c84-9bb5-74ae429912bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:24.609472 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20162-0719-4c84-9bb5-74ae429912bd admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.609751 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20162-0719-4c84-9bb5-74ae429912bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.610054 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20162-0719-4c84-9bb5-74ae429912bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.610767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20162-0719-4c84-9bb5-74ae429912bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:00:24.611067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20162-0719-4c84-9bb5-74ae429912bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:24.612646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20162-0719-4c84-9bb5-74ae429912bd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:24.624273 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1393/2784] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 16:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:00:24.628391 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9e332-2d19-4924-93eb-2aa9e66829d0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:24.637526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9e332-2d19-4924-93eb-2aa9e66829d0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:24.642134 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49e2a1-2283-47ff-8b9b-3e8b737dc05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:24.642778 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49e2a1-2283-47ff-8b9b-3e8b737dc05d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.643062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49e2a1-2283-47ff-8b9b-3e8b737dc05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.643341 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49e2a1-2283-47ff-8b9b-3e8b737dc05d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.644038 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49e2a1-2283-47ff-8b9b-3e8b737dc05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:24.645927 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49e2a1-2283-47ff-8b9b-3e8b737dc05d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:24.670584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1392/2785] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:24 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:00:24.674524 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20162-0719-4c84-9bb5-74ae429912bd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:24.684722 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20162-0719-4c84-9bb5-74ae429912bd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:24.738153 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30246237-ee7d-4ff3-9dc1-fee2804d4fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:24.738810 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246237-ee7d-4ff3-9dc1-fee2804d4fee admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.739095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246237-ee7d-4ff3-9dc1-fee2804d4fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.739373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246237-ee7d-4ff3-9dc1-fee2804d4fee admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.740043 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30246237-ee7d-4ff3-9dc1-fee2804d4fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:24.741947 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30246237-ee7d-4ff3-9dc1-fee2804d4fee admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:24.760752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1394/2786] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:24 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:00:24.764888 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49e2a1-2283-47ff-8b9b-3e8b737dc05d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:24.775375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49e2a1-2283-47ff-8b9b-3e8b737dc05d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:24.779939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7e71-ff7b-4bb8-a345-9f5c8fd766fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:24.780582 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7e71-ff7b-4bb8-a345-9f5c8fd766fb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.780859 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7e71-ff7b-4bb8-a345-9f5c8fd766fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.781129 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7e71-ff7b-4bb8-a345-9f5c8fd766fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.781843 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7e71-ff7b-4bb8-a345-9f5c8fd766fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:24.783449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7e71-ff7b-4bb8-a345-9f5c8fd766fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:24.794950 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1393/2787] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:24.798793 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30246237-ee7d-4ff3-9dc1-fee2804d4fee admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:24.808562 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30246237-ee7d-4ff3-9dc1-fee2804d4fee admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:24.813215 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28e01c-660d-44f4-b6c6-18a150d9d397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:24.813806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28e01c-660d-44f4-b6c6-18a150d9d397 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.814121 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28e01c-660d-44f4-b6c6-18a150d9d397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.814399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28e01c-660d-44f4-b6c6-18a150d9d397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.815116 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28e01c-660d-44f4-b6c6-18a150d9d397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:24.816698 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28e01c-660d-44f4-b6c6-18a150d9d397 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:24.826207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1395/2788] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:24.830100 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7e71-ff7b-4bb8-a345-9f5c8fd766fb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:24.840085 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7e71-ff7b-4bb8-a345-9f5c8fd766fb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:24.844647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0191979-6789-413d-82ee-f496e7447890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:24.845500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0191979-6789-413d-82ee-f496e7447890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.845777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0191979-6789-413d-82ee-f496e7447890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.846072 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0191979-6789-413d-82ee-f496e7447890 admin admin] PATH_INFO: `/v3/projects/aa069f106d3e4ed980787a63d3afcca6/users/8871ff0f4fd745bf94c8eec8a0ff8e10/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.860687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0191979-6789-413d-82ee-f496e7447890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa069f106d3e4ed980787a63d3afcca6, user_id=8871ff0f4fd745bf94c8eec8a0ff8e10, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:24.863377 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0191979-6789-413d-82ee-f496e7447890 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:24.875675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1394/2789] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:24 2022] PUT /identity/v3/projects/aa069f106d3e4ed980787a63d3afcca6/users/8871ff0f4fd745bf94c8eec8a0ff8e10/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:24.885862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d28c3-2652-40fd-ae43-39a27b920e94 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:24.886217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d28c3-2652-40fd-ae43-39a27b920e94 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:24.886498 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d28c3-2652-40fd-ae43-39a27b920e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:24.912042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7c7d28c3-2652-40fd-ae43-39a27b920e94 None None] MFA Rules not processed for user `8871ff0f4fd745bf94c8eec8a0ff8e10`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:24.913230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7c7d28c3-2652-40fd-ae43-39a27b920e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:24.974532 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1396/2790] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:24.979654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0191979-6789-413d-82ee-f496e7447890 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:25.047569 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0191979-6789-413d-82ee-f496e7447890 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:25.052186 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11136f-5578-48f4-855a-6b30f94d10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:25.052832 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11136f-5578-48f4-855a-6b30f94d10b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:25.053114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11136f-5578-48f4-855a-6b30f94d10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:25.053387 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11136f-5578-48f4-855a-6b30f94d10b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:25.054159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11136f-5578-48f4-855a-6b30f94d10b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:25.056039 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11136f-5578-48f4-855a-6b30f94d10b2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:25.081914 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1395/2791] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:24 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:25.085928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d28c3-2652-40fd-ae43-39a27b920e94 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:25.096814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d28c3-2652-40fd-ae43-39a27b920e94 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:25.150531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f1983-1e99-41ff-b8de-38f0edd8bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:25.151194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f1983-1e99-41ff-b8de-38f0edd8bc6a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:25.151495 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f1983-1e99-41ff-b8de-38f0edd8bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:25.151767 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f1983-1e99-41ff-b8de-38f0edd8bc6a admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:25.152463 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f1983-1e99-41ff-b8de-38f0edd8bc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:25.154456 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f1983-1e99-41ff-b8de-38f0edd8bc6a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:25.174152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1397/2792] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:25 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:25.178147 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11136f-5578-48f4-855a-6b30f94d10b2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:25.188227 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11136f-5578-48f4-855a-6b30f94d10b2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:25.192831 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01585709-d135-4eb4-99c0-969083bd2e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:25.193474 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01585709-d135-4eb4-99c0-969083bd2e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:25.193757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01585709-d135-4eb4-99c0-969083bd2e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:25.194056 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01585709-d135-4eb4-99c0-969083bd2e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:25.194779 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01585709-d135-4eb4-99c0-969083bd2e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:25.196876 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01585709-d135-4eb4-99c0-969083bd2e42 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:25.206965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1396/2793] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:25.210752 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f1983-1e99-41ff-b8de-38f0edd8bc6a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:25.220646 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f1983-1e99-41ff-b8de-38f0edd8bc6a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:25.225182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5e04b-9abb-4996-8670-7c22222bbb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:25.226061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e04b-9abb-4996-8670-7c22222bbb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:25.226342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e04b-9abb-4996-8670-7c22222bbb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:25.227106 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e04b-9abb-4996-8670-7c22222bbb65 admin admin] PATH_INFO: `/v3/projects/4896f4d253674d5eb5ed8f89dfd82947/users/00625eaef1ff4f6e855ad8a958c3f39c/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:25.241282 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5e04b-9abb-4996-8670-7c22222bbb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4896f4d253674d5eb5ed8f89dfd82947, user_id=00625eaef1ff4f6e855ad8a958c3f39c, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:25.244790 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5e04b-9abb-4996-8670-7c22222bbb65 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:25.256855 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1398/2794] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:25 2022] PUT /identity/v3/projects/4896f4d253674d5eb5ed8f89dfd82947/users/00625eaef1ff4f6e855ad8a958c3f39c/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:25.260759 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01585709-d135-4eb4-99c0-969083bd2e42 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:25.271045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01585709-d135-4eb4-99c0-969083bd2e42 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:25.325264 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379712f5-bd74-468e-a69a-a07185b5ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:25.326194 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379712f5-bd74-468e-a69a-a07185b5ccb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:25.326619 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379712f5-bd74-468e-a69a-a07185b5ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:25.327044 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379712f5-bd74-468e-a69a-a07185b5ccb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:25.328142 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379712f5-bd74-468e-a69a-a07185b5ccb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:25.330751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379712f5-bd74-468e-a69a-a07185b5ccb1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:25.345485 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1397/2795] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:25.349867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5e04b-9abb-4996-8670-7c22222bbb65 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:25.361671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5e04b-9abb-4996-8670-7c22222bbb65 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:25.367067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91838d0a-1fb7-4da4-aa98-f03fd9e83007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:25.368579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91838d0a-1fb7-4da4-aa98-f03fd9e83007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:25.368857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91838d0a-1fb7-4da4-aa98-f03fd9e83007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:25.369124 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91838d0a-1fb7-4da4-aa98-f03fd9e83007 admin admin] PATH_INFO: `/v3/projects/4896f4d253674d5eb5ed8f89dfd82947/users/00625eaef1ff4f6e855ad8a958c3f39c/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:25.371190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91838d0a-1fb7-4da4-aa98-f03fd9e83007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4896f4d253674d5eb5ed8f89dfd82947, user_id=00625eaef1ff4f6e855ad8a958c3f39c, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:25.373892 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91838d0a-1fb7-4da4-aa98-f03fd9e83007 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:25.384994 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1399/2796] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:25 2022] PUT /identity/v3/projects/4896f4d253674d5eb5ed8f89dfd82947/users/00625eaef1ff4f6e855ad8a958c3f39c/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:25.395052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdf53e-7e61-4dfd-9017-efb21d437303 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:25.395536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdf53e-7e61-4dfd-9017-efb21d437303 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:25.395638 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdf53e-7e61-4dfd-9017-efb21d437303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:25.421333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-04bdf53e-7e61-4dfd-9017-efb21d437303 None None] MFA Rules not processed for user `00625eaef1ff4f6e855ad8a958c3f39c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:25.422552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-04bdf53e-7e61-4dfd-9017-efb21d437303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:25.487668 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1398/2797] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:25.498987 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91838d0a-1fb7-4da4-aa98-f03fd9e83007 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:25.500769 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-91838d0a-1fb7-4da4-aa98-f03fd9e83007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:25.555576 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91838d0a-1fb7-4da4-aa98-f03fd9e83007 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:25.559158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63552011-04fc-4f78-92a0-e179e7f9f702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:25.559784 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63552011-04fc-4f78-92a0-e179e7f9f702 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:25.560060 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63552011-04fc-4f78-92a0-e179e7f9f702 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:25.560331 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63552011-04fc-4f78-92a0-e179e7f9f702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:25.568968 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63552011-04fc-4f78-92a0-e179e7f9f702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:25.571150 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63552011-04fc-4f78-92a0-e179e7f9f702 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:25.580546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1400/2798] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:25.651522 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdf53e-7e61-4dfd-9017-efb21d437303 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:25.663755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdf53e-7e61-4dfd-9017-efb21d437303 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:25.669382 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f91af5-cbe8-475a-8879-a122dddd2329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:25.670138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91af5-cbe8-475a-8879-a122dddd2329 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:25.672124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91af5-cbe8-475a-8879-a122dddd2329 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:25.672124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91af5-cbe8-475a-8879-a122dddd2329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:25.725647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f91af5-cbe8-475a-8879-a122dddd2329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:25.727104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f91af5-cbe8-475a-8879-a122dddd2329 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:25.736074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1399/2799] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:35.991857 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63552011-04fc-4f78-92a0-e179e7f9f702 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:36.059354 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63552011-04fc-4f78-92a0-e179e7f9f702 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:36.063920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:36.064772 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:36.065052 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:36.065324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] PATH_INFO: `/v3/users/8871ff0f4fd745bf94c8eec8a0ff8e10` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:36.066558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8871ff0f4fd745bf94c8eec8a0ff8e10)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:36.068476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:36.113486 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8871ff0f4fd745bf94c8eec8a0ff8e10'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.124547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8871ff0f4fd745bf94c8eec8a0ff8e10'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.125195 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8871ff0f4fd745bf94c8eec8a0ff8e10'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.125798 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8871ff0f4fd745bf94c8eec8a0ff8e10'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.132345 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8871ff0f4fd745bf94c8eec8a0ff8e10'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.144308 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1401/2800] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:35 2022] DELETE /identity/v3/users/8871ff0f4fd745bf94c8eec8a0ff8e10 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:36.149371 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d1ce-2488-4ef7-9e9e-ecf188a22bbb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:36.149765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d1ce-2488-4ef7-9e9e-ecf188a22bbb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:36.149947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d1ce-2488-4ef7-9e9e-ecf188a22bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:36.166291 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2a39d1ce-2488-4ef7-9e9e-ecf188a22bbb None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:36.167494 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a39d1ce-2488-4ef7-9e9e-ecf188a22bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:36.223459 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1400/2801] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:36.233149 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:36.234555 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:36.288898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427b54-1b28-4ec7-8eae-1e525b14aa72 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:36.292551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7229ce-6e6c-44bd-9a17-483fbbc1187c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:36.293181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7229ce-6e6c-44bd-9a17-483fbbc1187c service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:36.293457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7229ce-6e6c-44bd-9a17-483fbbc1187c service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:36.293726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7229ce-6e6c-44bd-9a17-483fbbc1187c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:36.302591 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7229ce-6e6c-44bd-9a17-483fbbc1187c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:36.304014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7229ce-6e6c-44bd-9a17-483fbbc1187c service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:36.313691 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1402/2802] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:36.571197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d1ce-2488-4ef7-9e9e-ecf188a22bbb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:36.572717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a39d1ce-2488-4ef7-9e9e-ecf188a22bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:36.584849 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d1ce-2488-4ef7-9e9e-ecf188a22bbb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:36.589515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:36.590414 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:36.590717 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:36.591103 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] PATH_INFO: `/v3/projects/aa069f106d3e4ed980787a63d3afcca6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:36.592306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa069f106d3e4ed980787a63d3afcca6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:36.594409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:36.640457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa069f106d3e4ed980787a63d3afcca6', 'request_id': 'req-1c22640b-e177-41fb-a0c9-7d2d41886d32'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.646367 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa069f106d3e4ed980787a63d3afcca6', 'request_id': 'req-1c22640b-e177-41fb-a0c9-7d2d41886d32'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.653744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa069f106d3e4ed980787a63d3afcca6', 'request_id': 'req-1c22640b-e177-41fb-a0c9-7d2d41886d32'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.664420 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] The token cache is being invalidate because project aa069f106d3e4ed980787a63d3afcca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:36.664645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.665272 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.666853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1401/2803] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:36 2022] DELETE /identity/v3/projects/aa069f106d3e4ed980787a63d3afcca6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:36.670940 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7229ce-6e6c-44bd-9a17-483fbbc1187c service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:36.680819 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7229ce-6e6c-44bd-9a17-483fbbc1187c service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:36.733281 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:36.734187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:36.734466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:36.734736 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] PATH_INFO: `/v3/users/00625eaef1ff4f6e855ad8a958c3f39c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:36.735891 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00625eaef1ff4f6e855ad8a958c3f39c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:36.737786 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:36.781768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00625eaef1ff4f6e855ad8a958c3f39c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.793482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00625eaef1ff4f6e855ad8a958c3f39c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.794176 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00625eaef1ff4f6e855ad8a958c3f39c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.794778 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00625eaef1ff4f6e855ad8a958c3f39c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.801224 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-89978bb7-9020-410f-9bf8-ac36f4f19668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00625eaef1ff4f6e855ad8a958c3f39c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:36.815434 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1403/2804] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:36 2022] DELETE /identity/v3/users/00625eaef1ff4f6e855ad8a958c3f39c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:37.078696 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.081091 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:37.095574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22640b-e177-41fb-a0c9-7d2d41886d32 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.151894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.152754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.153036 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.153310 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] PATH_INFO: `/v3/projects/4896f4d253674d5eb5ed8f89dfd82947` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.154549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4896f4d253674d5eb5ed8f89dfd82947)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.156437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.205245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4896f4d253674d5eb5ed8f89dfd82947', 'request_id': 'req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:37.211949 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4896f4d253674d5eb5ed8f89dfd82947', 'request_id': 'req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:37.219070 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4896f4d253674d5eb5ed8f89dfd82947', 'request_id': 'req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:37.229212 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] The token cache is being invalidate because project 4896f4d253674d5eb5ed8f89dfd82947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:37.229499 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:37.230201 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-45d9ce4d-dbe0-455d-94aa-0de39df76fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:37.232104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1402/2805] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:37 2022] DELETE /identity/v3/projects/4896f4d253674d5eb5ed8f89dfd82947 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:37.237101 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e82e8-9757-4656-ae65-6c562fc3b3a3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.237574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e82e8-9757-4656-ae65-6c562fc3b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.237695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e82e8-9757-4656-ae65-6c562fc3b3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.254675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b74e82e8-9757-4656-ae65-6c562fc3b3a3 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:37.255863 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b74e82e8-9757-4656-ae65-6c562fc3b3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:37.312926 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1404/2806] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 16:00:37.322321 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003adc1-41ad-43cd-969d-baa9de08e92e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.322616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003adc1-41ad-43cd-969d-baa9de08e92e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.322926 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003adc1-41ad-43cd-969d-baa9de08e92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.341754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5003adc1-41ad-43cd-969d-baa9de08e92e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:37.342979 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5003adc1-41ad-43cd-969d-baa9de08e92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:37.350832 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1403/2807] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:37.355518 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e82e8-9757-4656-ae65-6c562fc3b3a3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.365229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e82e8-9757-4656-ae65-6c562fc3b3a3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.370399 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a58ec-9401-43e1-a22d-d4787b5a3786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.371042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a58ec-9401-43e1-a22d-d4787b5a3786 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.371319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a58ec-9401-43e1-a22d-d4787b5a3786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.371589 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a58ec-9401-43e1-a22d-d4787b5a3786 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.372335 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a58ec-9401-43e1-a22d-d4787b5a3786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:00:37.372662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a58ec-9401-43e1-a22d-d4787b5a3786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.374295 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a58ec-9401-43e1-a22d-d4787b5a3786 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.385296 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1405/2808] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 16:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:00:37.389566 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003adc1-41ad-43cd-969d-baa9de08e92e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.398632 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003adc1-41ad-43cd-969d-baa9de08e92e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.403318 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73362248-63e0-472b-8a9d-4f30117674d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.403965 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73362248-63e0-472b-8a9d-4f30117674d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.404248 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73362248-63e0-472b-8a9d-4f30117674d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.404520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73362248-63e0-472b-8a9d-4f30117674d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.405211 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73362248-63e0-472b-8a9d-4f30117674d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.407139 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73362248-63e0-472b-8a9d-4f30117674d3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.434162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1404/2809] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:37 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:00:37.438309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a58ec-9401-43e1-a22d-d4787b5a3786 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.448025 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a58ec-9401-43e1-a22d-d4787b5a3786 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.504342 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f722-1979-430a-a487-f93bc2861034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.504934 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f722-1979-430a-a487-f93bc2861034 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.505217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f722-1979-430a-a487-f93bc2861034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.505492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f722-1979-430a-a487-f93bc2861034 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.506210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f722-1979-430a-a487-f93bc2861034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.508781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f722-1979-430a-a487-f93bc2861034 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.527689 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1406/2810] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:37 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:37.531752 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73362248-63e0-472b-8a9d-4f30117674d3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.544620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73362248-63e0-472b-8a9d-4f30117674d3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.549697 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d6ac-7a28-479c-bb5d-639733ae9542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.550476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d6ac-7a28-479c-bb5d-639733ae9542 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.550788 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d6ac-7a28-479c-bb5d-639733ae9542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.551095 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d6ac-7a28-479c-bb5d-639733ae9542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.552602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1d6ac-7a28-479c-bb5d-639733ae9542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.555193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1d6ac-7a28-479c-bb5d-639733ae9542 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.565706 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1405/2811] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 16:00:37.569641 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f722-1979-430a-a487-f93bc2861034 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.580182 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f722-1979-430a-a487-f93bc2861034 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.584804 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2423e-9887-4454-b3b5-8df955a51bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.585474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2423e-9887-4454-b3b5-8df955a51bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.585758 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2423e-9887-4454-b3b5-8df955a51bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.586067 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2423e-9887-4454-b3b5-8df955a51bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.586791 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2423e-9887-4454-b3b5-8df955a51bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.588519 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2423e-9887-4454-b3b5-8df955a51bf9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.598166 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1407/2812] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:37.602195 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d6ac-7a28-479c-bb5d-639733ae9542 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.611989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d6ac-7a28-479c-bb5d-639733ae9542 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.617273 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a9ab0-6a97-43d6-8352-6b952ea9b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.618166 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a9ab0-6a97-43d6-8352-6b952ea9b18f admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.618449 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a9ab0-6a97-43d6-8352-6b952ea9b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.618722 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a9ab0-6a97-43d6-8352-6b952ea9b18f admin admin] PATH_INFO: `/v3/projects/7faed97b15454e068a09c8d8171238e3/users/2d7d4382175b46c8b57f7b4140757580/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.633350 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a9ab0-6a97-43d6-8352-6b952ea9b18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7faed97b15454e068a09c8d8171238e3, user_id=2d7d4382175b46c8b57f7b4140757580, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.636014 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a9ab0-6a97-43d6-8352-6b952ea9b18f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.648789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1406/2813] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:37 2022] PUT /identity/v3/projects/7faed97b15454e068a09c8d8171238e3/users/2d7d4382175b46c8b57f7b4140757580/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 16:00:37.658868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761344f-7287-487f-a701-b13cafafe2a5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.659157 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761344f-7287-487f-a701-b13cafafe2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.659436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761344f-7287-487f-a701-b13cafafe2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.685258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6761344f-7287-487f-a701-b13cafafe2a5 None None] MFA Rules not processed for user `2d7d4382175b46c8b57f7b4140757580`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:37.686623 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6761344f-7287-487f-a701-b13cafafe2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:37.747534 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1408/2814] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:37.752002 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a9ab0-6a97-43d6-8352-6b952ea9b18f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.812517 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a9ab0-6a97-43d6-8352-6b952ea9b18f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.817052 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102747b-ad40-4dac-aad7-c2c5558937fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.817701 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102747b-ad40-4dac-aad7-c2c5558937fd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.817986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102747b-ad40-4dac-aad7-c2c5558937fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.818295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102747b-ad40-4dac-aad7-c2c5558937fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.818983 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102747b-ad40-4dac-aad7-c2c5558937fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.821380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102747b-ad40-4dac-aad7-c2c5558937fd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.845854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1407/2815] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:37 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:37.849760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761344f-7287-487f-a701-b13cafafe2a5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.860828 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761344f-7287-487f-a701-b13cafafe2a5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.914817 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f572e-08f8-46f9-854b-518a9a4f7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.915482 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f572e-08f8-46f9-854b-518a9a4f7e63 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.915792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f572e-08f8-46f9-854b-518a9a4f7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.916071 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f572e-08f8-46f9-854b-518a9a4f7e63 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.916748 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f572e-08f8-46f9-854b-518a9a4f7e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.918706 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f572e-08f8-46f9-854b-518a9a4f7e63 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.937812 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1409/2816] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:37 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:37.941787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102747b-ad40-4dac-aad7-c2c5558937fd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.952198 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102747b-ad40-4dac-aad7-c2c5558937fd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.956747 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cdaac-1998-4b7b-b65b-3e44dca3581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.957390 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cdaac-1998-4b7b-b65b-3e44dca3581b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.957675 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cdaac-1998-4b7b-b65b-3e44dca3581b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.957953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cdaac-1998-4b7b-b65b-3e44dca3581b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:37.958702 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cdaac-1998-4b7b-b65b-3e44dca3581b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:37.960280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cdaac-1998-4b7b-b65b-3e44dca3581b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:37.971017 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1408/2817] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:37.974860 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f572e-08f8-46f9-854b-518a9a4f7e63 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:37.984635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f572e-08f8-46f9-854b-518a9a4f7e63 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:37.989210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d176-d7ad-4a9c-afe5-565df2cbedc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:37.990109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d176-d7ad-4a9c-afe5-565df2cbedc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:37.990388 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d176-d7ad-4a9c-afe5-565df2cbedc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:37.990660 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d176-d7ad-4a9c-afe5-565df2cbedc6 admin admin] PATH_INFO: `/v3/projects/073e401e8f6a48dcb2fdc999df1669fd/users/619825b1112a40aa889efd00ead0b572/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:38.004313 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304d176-d7ad-4a9c-afe5-565df2cbedc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073e401e8f6a48dcb2fdc999df1669fd, user_id=619825b1112a40aa889efd00ead0b572, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:38.006971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304d176-d7ad-4a9c-afe5-565df2cbedc6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:38.019095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1410/2818] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:37 2022] PUT /identity/v3/projects/073e401e8f6a48dcb2fdc999df1669fd/users/619825b1112a40aa889efd00ead0b572/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:38.023034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cdaac-1998-4b7b-b65b-3e44dca3581b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:38.032882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cdaac-1998-4b7b-b65b-3e44dca3581b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:38.086745 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeb9cc-aefe-49cd-9346-4c963adcf5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:38.087330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeb9cc-aefe-49cd-9346-4c963adcf5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:38.087616 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeb9cc-aefe-49cd-9346-4c963adcf5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:38.087895 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeb9cc-aefe-49cd-9346-4c963adcf5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:38.088611 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeb9cc-aefe-49cd-9346-4c963adcf5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:38.090565 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeb9cc-aefe-49cd-9346-4c963adcf5c9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:38.100187 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1409/2819] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:38.104822 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d176-d7ad-4a9c-afe5-565df2cbedc6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:38.118284 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d176-d7ad-4a9c-afe5-565df2cbedc6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:38.122974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b04e34-2915-4011-8873-f26cf215499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:38.123849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b04e34-2915-4011-8873-f26cf215499b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:38.124133 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b04e34-2915-4011-8873-f26cf215499b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:38.124411 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b04e34-2915-4011-8873-f26cf215499b admin admin] PATH_INFO: `/v3/projects/073e401e8f6a48dcb2fdc999df1669fd/users/619825b1112a40aa889efd00ead0b572/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:38.126409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b04e34-2915-4011-8873-f26cf215499b admin admin] RBAC: Authorizing `identity:create_grant(project_id=073e401e8f6a48dcb2fdc999df1669fd, user_id=619825b1112a40aa889efd00ead0b572, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:38.129040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b04e34-2915-4011-8873-f26cf215499b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:38.139373 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1411/2820] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:38 2022] PUT /identity/v3/projects/073e401e8f6a48dcb2fdc999df1669fd/users/619825b1112a40aa889efd00ead0b572/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:38.150271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e0f08-3631-42ab-a570-f0501f6421cb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:38.150568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e0f08-3631-42ab-a570-f0501f6421cb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:38.150845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e0f08-3631-42ab-a570-f0501f6421cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:38.176531 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1b6e0f08-3631-42ab-a570-f0501f6421cb None None] MFA Rules not processed for user `619825b1112a40aa889efd00ead0b572`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:38.177723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1b6e0f08-3631-42ab-a570-f0501f6421cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:38.242392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1410/2821] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:38.254225 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b04e34-2915-4011-8873-f26cf215499b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:38.255980 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-74b04e34-2915-4011-8873-f26cf215499b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:38.311160 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b04e34-2915-4011-8873-f26cf215499b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:38.314802 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0307392-8674-4db5-a739-6c4ee64b0668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:38.315431 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0307392-8674-4db5-a739-6c4ee64b0668 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:38.315708 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0307392-8674-4db5-a739-6c4ee64b0668 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:38.315974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0307392-8674-4db5-a739-6c4ee64b0668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:38.324612 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0307392-8674-4db5-a739-6c4ee64b0668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:38.326048 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0307392-8674-4db5-a739-6c4ee64b0668 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:38.335085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1412/2822] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:38.397545 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e0f08-3631-42ab-a570-f0501f6421cb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:38.457771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e0f08-3631-42ab-a570-f0501f6421cb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:38.462806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:38.463659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:38.463946 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:38.464217 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] PATH_INFO: `/v3/users/2d7d4382175b46c8b57f7b4140757580` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:38.465410 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7d4382175b46c8b57f7b4140757580)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:38.467334 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:38.510854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7d4382175b46c8b57f7b4140757580'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:38.521947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7d4382175b46c8b57f7b4140757580'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:38.522612 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7d4382175b46c8b57f7b4140757580'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:38.529454 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7d4382175b46c8b57f7b4140757580'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:38.536290 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7d4382175b46c8b57f7b4140757580'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:38.542687 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1411/2823] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:38 2022] DELETE /identity/v3/users/2d7d4382175b46c8b57f7b4140757580 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:38.547179 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4975-7af7-4bb8-abcc-b22b892acb7a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:38.547473 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4975-7af7-4bb8-abcc-b22b892acb7a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:38.547753 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4975-7af7-4bb8-abcc-b22b892acb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:38.564897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e2be4975-7af7-4bb8-abcc-b22b892acb7a None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:38.566108 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e2be4975-7af7-4bb8-abcc-b22b892acb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:38.622729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1413/2824] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:38.632200 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:38.634204 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:38.689208 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b240-7c32-446b-a801-9563ce9fd9d3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:38.692821 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268e6c7-468a-4bca-a899-cef85763cb74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:38.693457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268e6c7-468a-4bca-a899-cef85763cb74 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:38.693744 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268e6c7-468a-4bca-a899-cef85763cb74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:38.694047 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268e6c7-468a-4bca-a899-cef85763cb74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:38.703345 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268e6c7-468a-4bca-a899-cef85763cb74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:38.704761 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268e6c7-468a-4bca-a899-cef85763cb74 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:38.714947 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1412/2825] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:38.967014 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be4975-7af7-4bb8-abcc-b22b892acb7a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:38.968438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e2be4975-7af7-4bb8-abcc-b22b892acb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:38.982425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be4975-7af7-4bb8-abcc-b22b892acb7a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:38.987483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:38.988367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:38.988630 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:38.988894 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] PATH_INFO: `/v3/projects/7faed97b15454e068a09c8d8171238e3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:38.990196 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7faed97b15454e068a09c8d8171238e3)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:38.992596 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:39.036746 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7faed97b15454e068a09c8d8171238e3', 'request_id': 'req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.042642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7faed97b15454e068a09c8d8171238e3', 'request_id': 'req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.049483 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7faed97b15454e068a09c8d8171238e3', 'request_id': 'req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.059755 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] The token cache is being invalidate because project 7faed97b15454e068a09c8d8171238e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:39.060037 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.060655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.062227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1414/2826] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:38 2022] DELETE /identity/v3/projects/7faed97b15454e068a09c8d8171238e3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:39.066153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268e6c7-468a-4bca-a899-cef85763cb74 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:39.075956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268e6c7-468a-4bca-a899-cef85763cb74 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:39.130114 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:39.130980 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:39.131266 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:39.131541 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] PATH_INFO: `/v3/users/619825b1112a40aa889efd00ead0b572` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:39.133295 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619825b1112a40aa889efd00ead0b572)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:39.135218 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:39.182441 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619825b1112a40aa889efd00ead0b572'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.198162 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619825b1112a40aa889efd00ead0b572'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.198845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619825b1112a40aa889efd00ead0b572'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.205333 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619825b1112a40aa889efd00ead0b572'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.212259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-531a67ae-786c-42d7-bcf7-cbcc0c3fe219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619825b1112a40aa889efd00ead0b572'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.218222 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1413/2827] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:39 2022] DELETE /identity/v3/users/619825b1112a40aa889efd00ead0b572 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:39.479216 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:39.480785 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:39.494604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f71db4-0549-4a24-824c-bf5cbe8f29b2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:39.549450 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:39.550343 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:39.550628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:39.550905 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] PATH_INFO: `/v3/projects/073e401e8f6a48dcb2fdc999df1669fd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:39.552065 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073e401e8f6a48dcb2fdc999df1669fd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:39.553967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:39.598867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073e401e8f6a48dcb2fdc999df1669fd', 'request_id': 'req-f4545d4d-fc76-4f6e-a526-b969d1448859'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.605158 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073e401e8f6a48dcb2fdc999df1669fd', 'request_id': 'req-f4545d4d-fc76-4f6e-a526-b969d1448859'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.612077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073e401e8f6a48dcb2fdc999df1669fd', 'request_id': 'req-f4545d4d-fc76-4f6e-a526-b969d1448859'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.622763 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] The token cache is being invalidate because project 073e401e8f6a48dcb2fdc999df1669fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:39.623049 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.623704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4545d4d-fc76-4f6e-a526-b969d1448859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:39.625207 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1415/2828] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:39 2022] DELETE /identity/v3/projects/073e401e8f6a48dcb2fdc999df1669fd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:39.630049 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1c304-2bd3-4b53-895f-06f84b89fbc7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:39.630347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1c304-2bd3-4b53-895f-06f84b89fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:39.630628 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1c304-2bd3-4b53-895f-06f84b89fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:39.648516 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0bf1c304-2bd3-4b53-895f-06f84b89fbc7 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:39.649719 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0bf1c304-2bd3-4b53-895f-06f84b89fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:39.706343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1414/2829] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:39.714522 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43877aa4-b0a3-4635-99a3-5d2fdab1b7af None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:39.714811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43877aa4-b0a3-4635-99a3-5d2fdab1b7af None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:39.715085 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43877aa4-b0a3-4635-99a3-5d2fdab1b7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:39.732847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-43877aa4-b0a3-4635-99a3-5d2fdab1b7af None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:39.734064 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-43877aa4-b0a3-4635-99a3-5d2fdab1b7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:39.742287 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1416/2830] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:39.746364 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1c304-2bd3-4b53-895f-06f84b89fbc7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:39.755769 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1c304-2bd3-4b53-895f-06f84b89fbc7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:39.761125 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35315-a05f-439b-b1e4-c7eb26a74509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:39.761780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35315-a05f-439b-b1e4-c7eb26a74509 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:39.762107 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35315-a05f-439b-b1e4-c7eb26a74509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:39.762393 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35315-a05f-439b-b1e4-c7eb26a74509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:39.763127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35315-a05f-439b-b1e4-c7eb26a74509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:00:39.763438 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35315-a05f-439b-b1e4-c7eb26a74509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:39.765066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35315-a05f-439b-b1e4-c7eb26a74509 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:39.776528 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1415/2831] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 16:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:00:39.780811 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43877aa4-b0a3-4635-99a3-5d2fdab1b7af None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:39.789806 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43877aa4-b0a3-4635-99a3-5d2fdab1b7af None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:39.794564 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bc28e-9324-4192-abf6-5ba7f49d4d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:39.795206 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bc28e-9324-4192-abf6-5ba7f49d4d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:39.795491 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bc28e-9324-4192-abf6-5ba7f49d4d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:39.795768 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bc28e-9324-4192-abf6-5ba7f49d4d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:39.796459 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bc28e-9324-4192-abf6-5ba7f49d4d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:39.798381 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bc28e-9324-4192-abf6-5ba7f49d4d18 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:39.823787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1417/2832] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:39 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:39.827869 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35315-a05f-439b-b1e4-c7eb26a74509 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:39.837673 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35315-a05f-439b-b1e4-c7eb26a74509 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:39.892626 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd0a71-3ee7-4b5d-a6a3-13b582dc4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:39.893287 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd0a71-3ee7-4b5d-a6a3-13b582dc4fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:39.893574 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd0a71-3ee7-4b5d-a6a3-13b582dc4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:39.893856 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd0a71-3ee7-4b5d-a6a3-13b582dc4fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:39.894570 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd0a71-3ee7-4b5d-a6a3-13b582dc4fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:39.896482 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd0a71-3ee7-4b5d-a6a3-13b582dc4fd8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:39.917045 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1416/2833] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:39 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:00:39.921161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bc28e-9324-4192-abf6-5ba7f49d4d18 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:39.931227 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bc28e-9324-4192-abf6-5ba7f49d4d18 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:39.935858 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b3dba-6ffd-40f0-ba3b-0ee35218bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:39.936509 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3dba-6ffd-40f0-ba3b-0ee35218bc44 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:39.936792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3dba-6ffd-40f0-ba3b-0ee35218bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:39.937068 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3dba-6ffd-40f0-ba3b-0ee35218bc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:39.937791 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b3dba-6ffd-40f0-ba3b-0ee35218bc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:39.939430 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b3dba-6ffd-40f0-ba3b-0ee35218bc44 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:39.949438 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1418/2834] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:39.953057 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd0a71-3ee7-4b5d-a6a3-13b582dc4fd8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:39.963309 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd0a71-3ee7-4b5d-a6a3-13b582dc4fd8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:39.967874 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376406b-ee6e-4ed2-b4f1-00dfc819f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:39.968520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376406b-ee6e-4ed2-b4f1-00dfc819f0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:39.968806 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376406b-ee6e-4ed2-b4f1-00dfc819f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:39.969101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376406b-ee6e-4ed2-b4f1-00dfc819f0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:39.969803 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376406b-ee6e-4ed2-b4f1-00dfc819f0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:39.971417 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376406b-ee6e-4ed2-b4f1-00dfc819f0b8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:39.981993 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1417/2835] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:39.985613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b3dba-6ffd-40f0-ba3b-0ee35218bc44 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:39.995579 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b3dba-6ffd-40f0-ba3b-0ee35218bc44 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:40.000161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd625392-1e80-44bd-84f8-9be1c1fc8815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:40.001017 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd625392-1e80-44bd-84f8-9be1c1fc8815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.001297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd625392-1e80-44bd-84f8-9be1c1fc8815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.001575 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd625392-1e80-44bd-84f8-9be1c1fc8815 admin admin] PATH_INFO: `/v3/projects/258d76f6e47044d49f50580bd736a4cf/users/6c2ddbd8c66f4a03af50b7f2f4d962e1/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.015634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd625392-1e80-44bd-84f8-9be1c1fc8815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258d76f6e47044d49f50580bd736a4cf, user_id=6c2ddbd8c66f4a03af50b7f2f4d962e1, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:40.018303 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd625392-1e80-44bd-84f8-9be1c1fc8815 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:40.031574 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1419/2836] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:39 2022] PUT /identity/v3/projects/258d76f6e47044d49f50580bd736a4cf/users/6c2ddbd8c66f4a03af50b7f2f4d962e1/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 16:00:40.042170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a1be4-eae6-4939-b94d-e0bb2d92739e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.042489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a1be4-eae6-4939-b94d-e0bb2d92739e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.042771 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a1be4-eae6-4939-b94d-e0bb2d92739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.068086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1a5a1be4-eae6-4939-b94d-e0bb2d92739e None None] MFA Rules not processed for user `6c2ddbd8c66f4a03af50b7f2f4d962e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:40.069278 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1a5a1be4-eae6-4939-b94d-e0bb2d92739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:40.129610 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1418/2837] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:40.134547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd625392-1e80-44bd-84f8-9be1c1fc8815 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:40.195404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd625392-1e80-44bd-84f8-9be1c1fc8815 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:40.199939 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1404b40-8926-4285-a215-2cf216bcd79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:40.200597 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1404b40-8926-4285-a215-2cf216bcd79d admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.200865 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1404b40-8926-4285-a215-2cf216bcd79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.201138 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1404b40-8926-4285-a215-2cf216bcd79d admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.201804 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1404b40-8926-4285-a215-2cf216bcd79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:40.203726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1404b40-8926-4285-a215-2cf216bcd79d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:40.232031 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1420/2838] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:40 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:40.233269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a1be4-eae6-4939-b94d-e0bb2d92739e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:40.243865 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a1be4-eae6-4939-b94d-e0bb2d92739e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:40.296601 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55399df6-6945-405c-86f0-e60f6405f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:40.297252 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55399df6-6945-405c-86f0-e60f6405f8da admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.297533 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55399df6-6945-405c-86f0-e60f6405f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.297804 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55399df6-6945-405c-86f0-e60f6405f8da admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.298506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55399df6-6945-405c-86f0-e60f6405f8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:40.300389 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55399df6-6945-405c-86f0-e60f6405f8da admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:40.321423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1419/2839] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:40 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:00:40.325820 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1404b40-8926-4285-a215-2cf216bcd79d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:40.336488 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1404b40-8926-4285-a215-2cf216bcd79d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:40.341050 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20462252-0a0c-42c6-b933-350b4fe74bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:40.341692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462252-0a0c-42c6-b933-350b4fe74bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.341971 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462252-0a0c-42c6-b933-350b4fe74bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.342272 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462252-0a0c-42c6-b933-350b4fe74bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.343009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20462252-0a0c-42c6-b933-350b4fe74bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:40.344588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20462252-0a0c-42c6-b933-350b4fe74bb7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:40.354656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1421/2840] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 16:00:40.358934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55399df6-6945-405c-86f0-e60f6405f8da admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:40.368620 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55399df6-6945-405c-86f0-e60f6405f8da admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:40.373653 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522708-7303-4443-996f-758afc5070b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:40.374798 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522708-7303-4443-996f-758afc5070b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.375245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522708-7303-4443-996f-758afc5070b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.375568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522708-7303-4443-996f-758afc5070b4 admin admin] PATH_INFO: `/v3/projects/87dcd53f08d844f6972fb4c02a92cbd6/users/b1ae97c005bb473bb58371bfa59c803f/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.391825 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92522708-7303-4443-996f-758afc5070b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87dcd53f08d844f6972fb4c02a92cbd6, user_id=b1ae97c005bb473bb58371bfa59c803f, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:40.394559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92522708-7303-4443-996f-758afc5070b4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:40.407048 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1420/2841] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:40 2022] PUT /identity/v3/projects/87dcd53f08d844f6972fb4c02a92cbd6/users/b1ae97c005bb473bb58371bfa59c803f/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:40.410920 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20462252-0a0c-42c6-b933-350b4fe74bb7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:40.420685 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20462252-0a0c-42c6-b933-350b4fe74bb7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:40.473635 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa50b0f-b83a-476f-be47-ca0a9759c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:40.474322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa50b0f-b83a-476f-be47-ca0a9759c327 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.474603 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa50b0f-b83a-476f-be47-ca0a9759c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.474875 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa50b0f-b83a-476f-be47-ca0a9759c327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.475590 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa50b0f-b83a-476f-be47-ca0a9759c327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:40.477197 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa50b0f-b83a-476f-be47-ca0a9759c327 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:40.486836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1422/2842] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:40.490823 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522708-7303-4443-996f-758afc5070b4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:40.501288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522708-7303-4443-996f-758afc5070b4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:40.505785 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1a208-bff4-4fef-84cb-0e1c081c346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:40.506681 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a208-bff4-4fef-84cb-0e1c081c346d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.506958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a208-bff4-4fef-84cb-0e1c081c346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.507279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a208-bff4-4fef-84cb-0e1c081c346d admin admin] PATH_INFO: `/v3/projects/87dcd53f08d844f6972fb4c02a92cbd6/users/b1ae97c005bb473bb58371bfa59c803f/roles/cb77715547a14bae950f68513af00d30` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.509749 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1a208-bff4-4fef-84cb-0e1c081c346d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87dcd53f08d844f6972fb4c02a92cbd6, user_id=b1ae97c005bb473bb58371bfa59c803f, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:40.512375 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1a208-bff4-4fef-84cb-0e1c081c346d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:40.522013 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1421/2843] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:40 2022] PUT /identity/v3/projects/87dcd53f08d844f6972fb4c02a92cbd6/users/b1ae97c005bb473bb58371bfa59c803f/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:40.583560 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09babf6b-911c-4719-9051-698b23febca0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.583846 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09babf6b-911c-4719-9051-698b23febca0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.584122 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09babf6b-911c-4719-9051-698b23febca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.610435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-09babf6b-911c-4719-9051-698b23febca0 None None] MFA Rules not processed for user `b1ae97c005bb473bb58371bfa59c803f`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:40.611642 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-09babf6b-911c-4719-9051-698b23febca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:40.675730 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1423/2844] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:40.686978 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1a208-bff4-4fef-84cb-0e1c081c346d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:40.688659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3aa1a208-bff4-4fef-84cb-0e1c081c346d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:40.743665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1a208-bff4-4fef-84cb-0e1c081c346d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:40.747239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898677a2-3a5e-43c3-b3ce-71317eed2ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:40.747866 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898677a2-3a5e-43c3-b3ce-71317eed2ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:40.748153 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898677a2-3a5e-43c3-b3ce-71317eed2ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:40.748430 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898677a2-3a5e-43c3-b3ce-71317eed2ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:40.757255 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898677a2-3a5e-43c3-b3ce-71317eed2ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:40.759330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898677a2-3a5e-43c3-b3ce-71317eed2ea5 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:40.768506 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1422/2845] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:41.281021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09babf6b-911c-4719-9051-698b23febca0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:41.339291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09babf6b-911c-4719-9051-698b23febca0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:41.343693 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:41.344539 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:41.344814 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:41.345083 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] PATH_INFO: `/v3/users/6c2ddbd8c66f4a03af50b7f2f4d962e1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:41.346259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2ddbd8c66f4a03af50b7f2f4d962e1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:41.348167 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:41.392437 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2ddbd8c66f4a03af50b7f2f4d962e1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.404416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2ddbd8c66f4a03af50b7f2f4d962e1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.405063 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2ddbd8c66f4a03af50b7f2f4d962e1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.405657 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2ddbd8c66f4a03af50b7f2f4d962e1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.412229 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2ddbd8c66f4a03af50b7f2f4d962e1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.424897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1424/2846] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:41 2022] DELETE /identity/v3/users/6c2ddbd8c66f4a03af50b7f2f4d962e1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:41.429415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917597b-255b-422d-957f-01dbb2f7f26e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:41.429894 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917597b-255b-422d-957f-01dbb2f7f26e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:41.430139 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917597b-255b-422d-957f-01dbb2f7f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:41.447536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8917597b-255b-422d-957f-01dbb2f7f26e None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:41.448725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8917597b-255b-422d-957f-01dbb2f7f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:41.511711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1423/2847] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:41.521089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:41.522535 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:41.576474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c165c2-4910-4baf-a32f-947fc6bd21e1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:41.580088 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22444c44-fb21-4179-b8d6-e89ea610ab1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:41.580721 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444c44-fb21-4179-b8d6-e89ea610ab1c service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:41.581003 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444c44-fb21-4179-b8d6-e89ea610ab1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:41.581275 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444c44-fb21-4179-b8d6-e89ea610ab1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:41.590026 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22444c44-fb21-4179-b8d6-e89ea610ab1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:41.591467 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22444c44-fb21-4179-b8d6-e89ea610ab1c service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:41.600615 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1425/2848] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:41.853603 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917597b-255b-422d-957f-01dbb2f7f26e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:41.855144 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8917597b-255b-422d-957f-01dbb2f7f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:41.867249 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917597b-255b-422d-957f-01dbb2f7f26e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:41.871789 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:41.872639 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:41.872923 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:41.873202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] PATH_INFO: `/v3/projects/258d76f6e47044d49f50580bd736a4cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:41.874416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] RBAC: Authorizing `identity:delete_project(project_id=258d76f6e47044d49f50580bd736a4cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:41.876306 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:41.922110 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258d76f6e47044d49f50580bd736a4cf', 'request_id': 'req-96e02f0e-f131-4855-8cc5-713f5f70913d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.928023 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258d76f6e47044d49f50580bd736a4cf', 'request_id': 'req-96e02f0e-f131-4855-8cc5-713f5f70913d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.935188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258d76f6e47044d49f50580bd736a4cf', 'request_id': 'req-96e02f0e-f131-4855-8cc5-713f5f70913d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.945886 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] The token cache is being invalidate because project 258d76f6e47044d49f50580bd736a4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:41.946193 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.946812 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:41.948347 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1424/2849] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:41 2022] DELETE /identity/v3/projects/258d76f6e47044d49f50580bd736a4cf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:41.952261 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22444c44-fb21-4179-b8d6-e89ea610ab1c service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:41.962445 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22444c44-fb21-4179-b8d6-e89ea610ab1c service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:42.016577 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:42.017428 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.017704 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.017973 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] PATH_INFO: `/v3/users/b1ae97c005bb473bb58371bfa59c803f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.019151 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ae97c005bb473bb58371bfa59c803f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:42.021051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:42.064099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ae97c005bb473bb58371bfa59c803f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.076238 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ae97c005bb473bb58371bfa59c803f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.076889 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ae97c005bb473bb58371bfa59c803f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.077501 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ae97c005bb473bb58371bfa59c803f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.084050 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c3fe412a-aaeb-45cf-b7f6-2b6896e2e573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ae97c005bb473bb58371bfa59c803f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.096256 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1426/2850] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:41 2022] DELETE /identity/v3/users/b1ae97c005bb473bb58371bfa59c803f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:42.366476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:42.367989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:42.380635 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e02f0e-f131-4855-8cc5-713f5f70913d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:42.436323 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:42.437183 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.437466 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.437743 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] PATH_INFO: `/v3/projects/87dcd53f08d844f6972fb4c02a92cbd6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.438956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87dcd53f08d844f6972fb4c02a92cbd6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:42.440854 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:42.491671 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87dcd53f08d844f6972fb4c02a92cbd6', 'request_id': 'req-3f33402e-c4fb-4814-91c8-183db0ecdc18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.500679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87dcd53f08d844f6972fb4c02a92cbd6', 'request_id': 'req-3f33402e-c4fb-4814-91c8-183db0ecdc18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.508117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87dcd53f08d844f6972fb4c02a92cbd6', 'request_id': 'req-3f33402e-c4fb-4814-91c8-183db0ecdc18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.518320 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] The token cache is being invalidate because project 87dcd53f08d844f6972fb4c02a92cbd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:42.518602 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.519220 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3f33402e-c4fb-4814-91c8-183db0ecdc18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:42.520986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1425/2851] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:42 2022] DELETE /identity/v3/projects/87dcd53f08d844f6972fb4c02a92cbd6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 16:00:42.525705 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d54bd-bef3-47a3-8869-3cde58ffacc8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.526194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d54bd-bef3-47a3-8869-3cde58ffacc8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.526306 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d54bd-bef3-47a3-8869-3cde58ffacc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.543823 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f12d54bd-bef3-47a3-8869-3cde58ffacc8 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:42.545016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f12d54bd-bef3-47a3-8869-3cde58ffacc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:42.601681 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1427/2852] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:42.609756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa86fbd-6cd0-4deb-af50-0697a6184249 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.609989 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa86fbd-6cd0-4deb-af50-0697a6184249 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.610428 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa86fbd-6cd0-4deb-af50-0697a6184249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.629811 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4fa86fbd-6cd0-4deb-af50-0697a6184249 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:42.631066 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4fa86fbd-6cd0-4deb-af50-0697a6184249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:42.638986 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1426/2853] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:42.642967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d54bd-bef3-47a3-8869-3cde58ffacc8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:42.652316 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d54bd-bef3-47a3-8869-3cde58ffacc8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:42.656831 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177ea3-b255-47b9-95d6-448457d04709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:42.657477 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177ea3-b255-47b9-95d6-448457d04709 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.657762 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177ea3-b255-47b9-95d6-448457d04709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.658077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177ea3-b255-47b9-95d6-448457d04709 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.658830 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177ea3-b255-47b9-95d6-448457d04709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:00:42.659139 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177ea3-b255-47b9-95d6-448457d04709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:42.660729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177ea3-b255-47b9-95d6-448457d04709 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:42.672318 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1428/2854] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 16:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:00:42.676418 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa86fbd-6cd0-4deb-af50-0697a6184249 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:42.685934 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa86fbd-6cd0-4deb-af50-0697a6184249 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:42.690491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363e2fb-d264-4a91-84e7-a26f5dc8842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:42.691124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363e2fb-d264-4a91-84e7-a26f5dc8842e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.691406 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363e2fb-d264-4a91-84e7-a26f5dc8842e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.691679 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363e2fb-d264-4a91-84e7-a26f5dc8842e admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.692365 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363e2fb-d264-4a91-84e7-a26f5dc8842e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:42.694265 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363e2fb-d264-4a91-84e7-a26f5dc8842e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:42.719159 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1427/2855] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:42 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:42.723192 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177ea3-b255-47b9-95d6-448457d04709 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:42.733159 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177ea3-b255-47b9-95d6-448457d04709 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:42.786312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da0935-96e8-4fb1-8290-4e1ac60c7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:42.786967 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da0935-96e8-4fb1-8290-4e1ac60c7725 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.787252 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da0935-96e8-4fb1-8290-4e1ac60c7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.787529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da0935-96e8-4fb1-8290-4e1ac60c7725 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.788210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da0935-96e8-4fb1-8290-4e1ac60c7725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:42.790378 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da0935-96e8-4fb1-8290-4e1ac60c7725 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:42.815021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1429/2856] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:42 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:42.816138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363e2fb-d264-4a91-84e7-a26f5dc8842e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:42.826841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363e2fb-d264-4a91-84e7-a26f5dc8842e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:42.831512 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b38c2-897f-4358-8089-dfed8c4016ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:42.832188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b38c2-897f-4358-8089-dfed8c4016ea admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.832471 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b38c2-897f-4358-8089-dfed8c4016ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.832746 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b38c2-897f-4358-8089-dfed8c4016ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.833495 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b38c2-897f-4358-8089-dfed8c4016ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:42.835138 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b38c2-897f-4358-8089-dfed8c4016ea admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:42.846127 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1428/2857] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 16:00:42.851353 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da0935-96e8-4fb1-8290-4e1ac60c7725 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:42.862695 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da0935-96e8-4fb1-8290-4e1ac60c7725 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:42.867997 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaef30b-e3e1-48fb-843d-7c145ba7d62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:42.868656 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef30b-e3e1-48fb-843d-7c145ba7d62e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.868938 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef30b-e3e1-48fb-843d-7c145ba7d62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.869212 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef30b-e3e1-48fb-843d-7c145ba7d62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.869928 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaef30b-e3e1-48fb-843d-7c145ba7d62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:42.871551 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaef30b-e3e1-48fb-843d-7c145ba7d62e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:42.881515 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1430/2858] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:42.886579 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b38c2-897f-4358-8089-dfed8c4016ea admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:42.896647 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b38c2-897f-4358-8089-dfed8c4016ea admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:42.901556 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320bdad-383c-4ad7-864c-e2e03d4129f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:42.902481 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320bdad-383c-4ad7-864c-e2e03d4129f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.902766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320bdad-383c-4ad7-864c-e2e03d4129f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.903040 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320bdad-383c-4ad7-864c-e2e03d4129f3 admin admin] PATH_INFO: `/v3/projects/0d1fa4255408414b8d51cdc8fd7f3706/users/66d2673a059d4b6b8174bd1833211298/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.917540 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320bdad-383c-4ad7-864c-e2e03d4129f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1fa4255408414b8d51cdc8fd7f3706, user_id=66d2673a059d4b6b8174bd1833211298, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:42.920228 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320bdad-383c-4ad7-864c-e2e03d4129f3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:42.932899 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1429/2859] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:42 2022] PUT /identity/v3/projects/0d1fa4255408414b8d51cdc8fd7f3706/users/66d2673a059d4b6b8174bd1833211298/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:42.942986 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4593487-3e25-4e0e-a5c6-f4e70393f10a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:42.943277 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4593487-3e25-4e0e-a5c6-f4e70393f10a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:42.943581 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4593487-3e25-4e0e-a5c6-f4e70393f10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:42.969436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a4593487-3e25-4e0e-a5c6-f4e70393f10a None None] MFA Rules not processed for user `66d2673a059d4b6b8174bd1833211298`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:42.970661 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a4593487-3e25-4e0e-a5c6-f4e70393f10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:43.031787 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1431/2860] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:43.036164 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320bdad-383c-4ad7-864c-e2e03d4129f3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:43.095202 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320bdad-383c-4ad7-864c-e2e03d4129f3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:43.099864 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164245c-96dd-4fa7-82d8-72fb5b126531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:43.100505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164245c-96dd-4fa7-82d8-72fb5b126531 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:43.100783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164245c-96dd-4fa7-82d8-72fb5b126531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:43.101549 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164245c-96dd-4fa7-82d8-72fb5b126531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:43.102268 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164245c-96dd-4fa7-82d8-72fb5b126531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:43.104143 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164245c-96dd-4fa7-82d8-72fb5b126531 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:43.128552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1430/2861] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:43 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:43.133006 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4593487-3e25-4e0e-a5c6-f4e70393f10a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:43.143521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4593487-3e25-4e0e-a5c6-f4e70393f10a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:43.200454 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d9c8e-e5e8-4928-bf16-5da2a837f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:43.201126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d9c8e-e5e8-4928-bf16-5da2a837f717 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:43.201409 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d9c8e-e5e8-4928-bf16-5da2a837f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:43.201684 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d9c8e-e5e8-4928-bf16-5da2a837f717 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:43.202394 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d9c8e-e5e8-4928-bf16-5da2a837f717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:43.204312 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d9c8e-e5e8-4928-bf16-5da2a837f717 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:43.223862 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1432/2862] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:43 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:43.227787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164245c-96dd-4fa7-82d8-72fb5b126531 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:43.238016 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164245c-96dd-4fa7-82d8-72fb5b126531 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:43.242558 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f5a70-0e94-4490-b621-66481ccb051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:43.243209 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f5a70-0e94-4490-b621-66481ccb051d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:43.243490 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f5a70-0e94-4490-b621-66481ccb051d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:43.243766 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f5a70-0e94-4490-b621-66481ccb051d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:43.244489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f5a70-0e94-4490-b621-66481ccb051d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:43.246088 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f5a70-0e94-4490-b621-66481ccb051d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:43.256214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1431/2863] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:43.260634 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d9c8e-e5e8-4928-bf16-5da2a837f717 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:43.270258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d9c8e-e5e8-4928-bf16-5da2a837f717 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:43.275468 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96612847-d431-453a-bf38-bd7d9303f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:43.276333 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612847-d431-453a-bf38-bd7d9303f8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:43.276613 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612847-d431-453a-bf38-bd7d9303f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:43.276888 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612847-d431-453a-bf38-bd7d9303f8d8 admin admin] PATH_INFO: `/v3/projects/bf5a083a6478460b9a759e4ae2f03c8e/users/102b620bcc0e4e9ab9cf822e25652745/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:43.290959 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96612847-d431-453a-bf38-bd7d9303f8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5a083a6478460b9a759e4ae2f03c8e, user_id=102b620bcc0e4e9ab9cf822e25652745, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:43.293607 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96612847-d431-453a-bf38-bd7d9303f8d8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:43.305492 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1433/2864] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:43 2022] PUT /identity/v3/projects/bf5a083a6478460b9a759e4ae2f03c8e/users/102b620bcc0e4e9ab9cf822e25652745/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:43.309168 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f5a70-0e94-4490-b621-66481ccb051d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:43.322526 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f5a70-0e94-4490-b621-66481ccb051d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:43.377970 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf49f7-ca1f-430c-b61a-0698991208c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:43.378740 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf49f7-ca1f-430c-b61a-0698991208c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:43.378977 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf49f7-ca1f-430c-b61a-0698991208c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:43.379240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf49f7-ca1f-430c-b61a-0698991208c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:43.379958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf49f7-ca1f-430c-b61a-0698991208c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:43.381568 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf49f7-ca1f-430c-b61a-0698991208c9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:43.391584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1432/2865] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:43.396054 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96612847-d431-453a-bf38-bd7d9303f8d8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:43.406520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96612847-d431-453a-bf38-bd7d9303f8d8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:43.411235 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50995399-e5c6-4012-adb6-62e398df9faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:43.412111 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50995399-e5c6-4012-adb6-62e398df9faa admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:43.412393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50995399-e5c6-4012-adb6-62e398df9faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:43.412667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50995399-e5c6-4012-adb6-62e398df9faa admin admin] PATH_INFO: `/v3/projects/bf5a083a6478460b9a759e4ae2f03c8e/users/102b620bcc0e4e9ab9cf822e25652745/roles/cb77715547a14bae950f68513af00d30` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:43.414667 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50995399-e5c6-4012-adb6-62e398df9faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5a083a6478460b9a759e4ae2f03c8e, user_id=102b620bcc0e4e9ab9cf822e25652745, role_id=cb77715547a14bae950f68513af00d30)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:43.417297 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50995399-e5c6-4012-adb6-62e398df9faa admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:43.427251 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1434/2866] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:43 2022] PUT /identity/v3/projects/bf5a083a6478460b9a759e4ae2f03c8e/users/102b620bcc0e4e9ab9cf822e25652745/roles/cb77715547a14bae950f68513af00d30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:43.438463 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fd75c-d33c-4e6e-9d0e-f2c4c6d56c78 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:43.438959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fd75c-d33c-4e6e-9d0e-f2c4c6d56c78 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:43.439062 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fd75c-d33c-4e6e-9d0e-f2c4c6d56c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:43.465578 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-001fd75c-d33c-4e6e-9d0e-f2c4c6d56c78 None None] MFA Rules not processed for user `102b620bcc0e4e9ab9cf822e25652745`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:43.466813 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-001fd75c-d33c-4e6e-9d0e-f2c4c6d56c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:43.531801 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1433/2867] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:43.542396 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50995399-e5c6-4012-adb6-62e398df9faa admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:43.544152 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-50995399-e5c6-4012-adb6-62e398df9faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:43.598675 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50995399-e5c6-4012-adb6-62e398df9faa admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:43.602293 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d790bf-6d08-40d2-8cc2-70ebb710370b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:43.602921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d790bf-6d08-40d2-8cc2-70ebb710370b service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:43.603203 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d790bf-6d08-40d2-8cc2-70ebb710370b service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:43.603480 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d790bf-6d08-40d2-8cc2-70ebb710370b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:43.656009 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d790bf-6d08-40d2-8cc2-70ebb710370b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:43.657359 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d790bf-6d08-40d2-8cc2-70ebb710370b service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:43.665921 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1435/2868] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:47.775913 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fd75c-d33c-4e6e-9d0e-f2c4c6d56c78 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:47.777330 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-001fd75c-d33c-4e6e-9d0e-f2c4c6d56c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:47.788966 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fd75c-d33c-4e6e-9d0e-f2c4c6d56c78 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:47.792489 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72479af-dda6-4463-ac85-e51e27881421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:47.793115 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72479af-dda6-4463-ac85-e51e27881421 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:47.793401 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72479af-dda6-4463-ac85-e51e27881421 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:47.793680 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72479af-dda6-4463-ac85-e51e27881421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:47.802667 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72479af-dda6-4463-ac85-e51e27881421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:47.804627 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72479af-dda6-4463-ac85-e51e27881421 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:47.815181 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1434/2869] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:52.643120 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d790bf-6d08-40d2-8cc2-70ebb710370b service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:52.704278 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d790bf-6d08-40d2-8cc2-70ebb710370b service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:52.708781 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:52.709643 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:52.710444 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:52.710728 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] PATH_INFO: `/v3/users/66d2673a059d4b6b8174bd1833211298` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:52.711902 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d2673a059d4b6b8174bd1833211298)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:52.713815 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:52.758594 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d2673a059d4b6b8174bd1833211298'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:52.769713 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d2673a059d4b6b8174bd1833211298'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:52.770367 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d2673a059d4b6b8174bd1833211298'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:52.770974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d2673a059d4b6b8174bd1833211298'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:52.778156 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d2673a059d4b6b8174bd1833211298'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:52.791205 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1436/2870] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:52 2022] DELETE /identity/v3/users/66d2673a059d4b6b8174bd1833211298 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:52.795665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdab14-4df1-48a6-b020-4913e325c273 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:52.796179 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdab14-4df1-48a6-b020-4913e325c273 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:52.796294 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdab14-4df1-48a6-b020-4913e325c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:52.814239 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-18cdab14-4df1-48a6-b020-4913e325c273 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:52.815423 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-18cdab14-4df1-48a6-b020-4913e325c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:52.871399 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1435/2871] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:52.880849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:52.882830 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:52.937180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85991b-053f-40a8-a577-ae7f54896c2c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:52.940836 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815f3ca-be11-44f9-91c0-d3b4c78579ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:52.941475 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f3ca-be11-44f9-91c0-d3b4c78579ec service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:52.941759 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f3ca-be11-44f9-91c0-d3b4c78579ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:52.942061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f3ca-be11-44f9-91c0-d3b4c78579ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:52.951512 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815f3ca-be11-44f9-91c0-d3b4c78579ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:52.953365 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815f3ca-be11-44f9-91c0-d3b4c78579ec service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:52.965095 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1437/2872] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:53.217366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdab14-4df1-48a6-b020-4913e325c273 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:53.218834 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-18cdab14-4df1-48a6-b020-4913e325c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:53.235754 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdab14-4df1-48a6-b020-4913e325c273 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:53.241237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:53.242188 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:53.242470 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:53.242751 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] PATH_INFO: `/v3/projects/0d1fa4255408414b8d51cdc8fd7f3706` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:53.243939 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1fa4255408414b8d51cdc8fd7f3706)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:53.245919 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:53.290439 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1fa4255408414b8d51cdc8fd7f3706', 'request_id': 'req-04644b68-ce00-4242-aacd-b1b8daf7836b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.296584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1fa4255408414b8d51cdc8fd7f3706', 'request_id': 'req-04644b68-ce00-4242-aacd-b1b8daf7836b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.304505 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1fa4255408414b8d51cdc8fd7f3706', 'request_id': 'req-04644b68-ce00-4242-aacd-b1b8daf7836b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.314669 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] The token cache is being invalidate because project 0d1fa4255408414b8d51cdc8fd7f3706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:53.314958 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.315577 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.317102 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1436/2873] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:53 2022] DELETE /identity/v3/projects/0d1fa4255408414b8d51cdc8fd7f3706 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:53.321662 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815f3ca-be11-44f9-91c0-d3b4c78579ec service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:53.331079 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815f3ca-be11-44f9-91c0-d3b4c78579ec service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:53.384404 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:53.385259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:53.385538 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:53.385809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] PATH_INFO: `/v3/users/102b620bcc0e4e9ab9cf822e25652745` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:53.386995 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=102b620bcc0e4e9ab9cf822e25652745)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:53.388897 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:53.432451 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102b620bcc0e4e9ab9cf822e25652745'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.443531 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102b620bcc0e4e9ab9cf822e25652745'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.444173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102b620bcc0e4e9ab9cf822e25652745'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.445309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102b620bcc0e4e9ab9cf822e25652745'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.451771 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c188b6f2-c42a-47fc-90e4-6e38701fa7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102b620bcc0e4e9ab9cf822e25652745'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.463520 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1438/2874] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:00:53 2022] DELETE /identity/v3/users/102b620bcc0e4e9ab9cf822e25652745 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:53.723245 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:53.724703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:53.739274 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04644b68-ce00-4242-aacd-b1b8daf7836b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:53.794780 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:53.795630 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:53.795910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:53.796460 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] PATH_INFO: `/v3/projects/bf5a083a6478460b9a759e4ae2f03c8e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:53.797327 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5a083a6478460b9a759e4ae2f03c8e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:53.799237 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:53.843259 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5a083a6478460b9a759e4ae2f03c8e', 'request_id': 'req-32d19601-594c-4ed0-b3af-8e1795509c69'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.849126 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5a083a6478460b9a759e4ae2f03c8e', 'request_id': 'req-32d19601-594c-4ed0-b3af-8e1795509c69'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.856956 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5a083a6478460b9a759e4ae2f03c8e', 'request_id': 'req-32d19601-594c-4ed0-b3af-8e1795509c69'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.866623 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] The token cache is being invalidate because project bf5a083a6478460b9a759e4ae2f03c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:00:53.866907 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.867523 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-32d19601-594c-4ed0-b3af-8e1795509c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:00:53.869051 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1437/2875] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:00:53 2022] DELETE /identity/v3/projects/bf5a083a6478460b9a759e4ae2f03c8e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:00:53.875137 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fa827-1976-4dde-8544-c3ac79a5da66 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:53.875626 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fa827-1976-4dde-8544-c3ac79a5da66 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:53.875726 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fa827-1976-4dde-8544-c3ac79a5da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:53.892915 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6c9fa827-1976-4dde-8544-c3ac79a5da66 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:53.894146 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6c9fa827-1976-4dde-8544-c3ac79a5da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:53.951027 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1439/2876] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:53.959407 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bcc4c-0b45-49c1-9c03-c2f91ffc7b01 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:53.959694 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bcc4c-0b45-49c1-9c03-c2f91ffc7b01 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:53.960018 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bcc4c-0b45-49c1-9c03-c2f91ffc7b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:53.977631 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f12bcc4c-0b45-49c1-9c03-c2f91ffc7b01 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:53.978799 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f12bcc4c-0b45-49c1-9c03-c2f91ffc7b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:53.986786 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1438/2877] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:53.990856 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fa827-1976-4dde-8544-c3ac79a5da66 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:54.000887 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fa827-1976-4dde-8544-c3ac79a5da66 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:54.005528 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b95f2c-f05c-45c8-aa53-4138e27fd1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:54.006210 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b95f2c-f05c-45c8-aa53-4138e27fd1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:54.006497 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b95f2c-f05c-45c8-aa53-4138e27fd1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:54.006776 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b95f2c-f05c-45c8-aa53-4138e27fd1d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:54.008090 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b95f2c-f05c-45c8-aa53-4138e27fd1d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:00:54.008398 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b95f2c-f05c-45c8-aa53-4138e27fd1d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:54.010023 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b95f2c-f05c-45c8-aa53-4138e27fd1d3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:54.021143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1440/2878] 10.222.0.75 () {58 vars in 1152 bytes} [Tue May 17 16:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:00:54.025342 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bcc4c-0b45-49c1-9c03-c2f91ffc7b01 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:54.034240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bcc4c-0b45-49c1-9c03-c2f91ffc7b01 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:54.038882 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff6f29-6fa2-49cd-a411-54815a72105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:54.039520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6f29-6fa2-49cd-a411-54815a72105e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:54.039825 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6f29-6fa2-49cd-a411-54815a72105e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:54.040086 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6f29-6fa2-49cd-a411-54815a72105e admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:54.040783 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff6f29-6fa2-49cd-a411-54815a72105e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:54.042713 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff6f29-6fa2-49cd-a411-54815a72105e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:54.071042 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1439/2879] 10.222.0.75 () {60 vars in 1152 bytes} [Tue May 17 16:00:54 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:00:54.072311 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b95f2c-f05c-45c8-aa53-4138e27fd1d3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:54.082326 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b95f2c-f05c-45c8-aa53-4138e27fd1d3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:54.137242 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda83eea-174a-4e29-a631-69bbc40a8bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:54.137907 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda83eea-174a-4e29-a631-69bbc40a8bed admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:54.138217 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda83eea-174a-4e29-a631-69bbc40a8bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:54.138500 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda83eea-174a-4e29-a631-69bbc40a8bed admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:54.139173 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda83eea-174a-4e29-a631-69bbc40a8bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:54.141143 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda83eea-174a-4e29-a631-69bbc40a8bed admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:54.161259 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1441/2880] 10.222.0.75 () {60 vars in 1143 bytes} [Tue May 17 16:00:54 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:00:54.165945 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff6f29-6fa2-49cd-a411-54815a72105e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:54.176124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff6f29-6fa2-49cd-a411-54815a72105e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:54.181269 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e5ab6-6163-4b18-b7e9-e73b8f19ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:54.181920 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e5ab6-6163-4b18-b7e9-e73b8f19ff32 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:54.182233 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e5ab6-6163-4b18-b7e9-e73b8f19ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:54.182510 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e5ab6-6163-4b18-b7e9-e73b8f19ff32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:54.183258 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e5ab6-6163-4b18-b7e9-e73b8f19ff32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:54.184845 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e5ab6-6163-4b18-b7e9-e73b8f19ff32 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:54.195453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1440/2881] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:54.199124 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda83eea-174a-4e29-a631-69bbc40a8bed admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:54.209099 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda83eea-174a-4e29-a631-69bbc40a8bed admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:54.213727 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb744d1-4ddb-4e46-84d2-52e04af4ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:54.214474 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb744d1-4ddb-4e46-84d2-52e04af4ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:54.214761 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb744d1-4ddb-4e46-84d2-52e04af4ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:54.215042 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb744d1-4ddb-4e46-84d2-52e04af4ec27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:54.215760 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb744d1-4ddb-4e46-84d2-52e04af4ec27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:54.217361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb744d1-4ddb-4e46-84d2-52e04af4ec27 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:54.227062 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1442/2882] 10.222.0.75 () {58 vars in 1121 bytes} [Tue May 17 16:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:00:54.231074 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e5ab6-6163-4b18-b7e9-e73b8f19ff32 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:54.241654 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e5ab6-6163-4b18-b7e9-e73b8f19ff32 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:54.246280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c664c5-531e-4412-ac8a-bda77a68d8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:54.247139 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c664c5-531e-4412-ac8a-bda77a68d8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:54.247416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c664c5-531e-4412-ac8a-bda77a68d8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:54.247688 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c664c5-531e-4412-ac8a-bda77a68d8d4 admin admin] PATH_INFO: `/v3/projects/e2d2f895d6cb4e218216aa316538d046/users/67020a523bd14f3689b3349492c90337/roles/77cf47a512e2416eb2126eb72db4f14b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:54.262586 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c664c5-531e-4412-ac8a-bda77a68d8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d2f895d6cb4e218216aa316538d046, user_id=67020a523bd14f3689b3349492c90337, role_id=77cf47a512e2416eb2126eb72db4f14b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:54.265214 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c664c5-531e-4412-ac8a-bda77a68d8d4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:54.277453 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1441/2883] 10.222.0.75 () {60 vars in 1482 bytes} [Tue May 17 16:00:54 2022] PUT /identity/v3/projects/e2d2f895d6cb4e218216aa316538d046/users/67020a523bd14f3689b3349492c90337/roles/77cf47a512e2416eb2126eb72db4f14b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 16:00:54.282479 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8f40d-ee05-4837-a6a3-834843524022 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:54.282809 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8f40d-ee05-4837-a6a3-834843524022 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:54.283089 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8f40d-ee05-4837-a6a3-834843524022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:54.300269 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-01d8f40d-ee05-4837-a6a3-834843524022 None None] MFA Rules not processed for user `2ee5e213008a431f98430b648aa9d659`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:54.301347 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-01d8f40d-ee05-4837-a6a3-834843524022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:54.357744 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1443/2884] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:54.368083 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c664c5-531e-4412-ac8a-bda77a68d8d4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:54.369765 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d8c664c5-531e-4412-ac8a-bda77a68d8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:54.424007 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c664c5-531e-4412-ac8a-bda77a68d8d4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:54.427755 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aeb37-5f82-40cb-a765-51ae65095d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:54.428381 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aeb37-5f82-40cb-a765-51ae65095d08 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:54.428655 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aeb37-5f82-40cb-a765-51ae65095d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:54.429515 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aeb37-5f82-40cb-a765-51ae65095d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:54.438380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aeb37-5f82-40cb-a765-51ae65095d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:54.439800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aeb37-5f82-40cb-a765-51ae65095d08 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:54.450370 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1442/2885] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:55.052267 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37ae3-cc18-4e9c-9f50-9f2fd004c5ff None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:55.052868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37ae3-cc18-4e9c-9f50-9f2fd004c5ff None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:55.052868 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37ae3-cc18-4e9c-9f50-9f2fd004c5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:55.080847 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-63b37ae3-cc18-4e9c-9f50-9f2fd004c5ff None None] MFA Rules not processed for user `67020a523bd14f3689b3349492c90337`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:55.082109 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-63b37ae3-cc18-4e9c-9f50-9f2fd004c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:55.150185 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1444/2886] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:55.161243 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aeb37-5f82-40cb-a765-51ae65095d08 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:55.162703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-276aeb37-5f82-40cb-a765-51ae65095d08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:55.218034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aeb37-5f82-40cb-a765-51ae65095d08 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:55.221498 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fc9b6-f29f-418c-8886-7d3893a55d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:55.222170 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fc9b6-f29f-418c-8886-7d3893a55d76 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:55.222450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fc9b6-f29f-418c-8886-7d3893a55d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:55.222723 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fc9b6-f29f-418c-8886-7d3893a55d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:55.232034 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fc9b6-f29f-418c-8886-7d3893a55d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:55.233458 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fc9b6-f29f-418c-8886-7d3893a55d76 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:55.244078 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1443/2887] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:56.573460 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b670c-c8e6-4cee-b4b8-6b4f4e0865a4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:56.573972 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b670c-c8e6-4cee-b4b8-6b4f4e0865a4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:56.574100 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b670c-c8e6-4cee-b4b8-6b4f4e0865a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:56.592457 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-989b670c-c8e6-4cee-b4b8-6b4f4e0865a4 None None] MFA Rules not processed for user `67020a523bd14f3689b3349492c90337`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:00:56.593639 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-989b670c-c8e6-4cee-b4b8-6b4f4e0865a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:56.600346 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1445/2888] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:00:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:00:56.831279 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fc9b6-f29f-418c-8886-7d3893a55d76 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:56.841360 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fc9b6-f29f-418c-8886-7d3893a55d76 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:56.844912 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:56.845536 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:56.845814 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:56.846124 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:56.847853 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:56.857450 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:56.858879 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:56.866753 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1444/2889] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:00:57.164126 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b670c-c8e6-4cee-b4b8-6b4f4e0865a4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:00:57.165521 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-989b670c-c8e6-4cee-b4b8-6b4f4e0865a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:57.232976 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b670c-c8e6-4cee-b4b8-6b4f4e0865a4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:00:57.237886 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795edf9a-026c-4008-8ae4-2553e301ce01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:00:57.238558 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795edf9a-026c-4008-8ae4-2553e301ce01 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:00:57.238837 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795edf9a-026c-4008-8ae4-2553e301ce01 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:00:57.239112 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795edf9a-026c-4008-8ae4-2553e301ce01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:00:57.241001 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-795edf9a-026c-4008-8ae4-2553e301ce01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:00:57.253549 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795edf9a-026c-4008-8ae4-2553e301ce01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:00:57.255161 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795edf9a-026c-4008-8ae4-2553e301ce01 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:00:57.265476 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1446/2890] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:00:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:01:06.248019 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:01:06.249595 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:01:06.321976 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefeb8a-0983-465b-bd63-f25c6dbf18c4 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:01:06.327493 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d4151-c88a-4d85-8ec9-071ca71a8c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:01:06.328139 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d4151-c88a-4d85-8ec9-071ca71a8c8c service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:01:06.328424 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d4151-c88a-4d85-8ec9-071ca71a8c8c service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:01:06.328703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d4151-c88a-4d85-8ec9-071ca71a8c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:01:06.330524 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-681d4151-c88a-4d85-8ec9-071ca71a8c8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:01:06.342710 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d4151-c88a-4d85-8ec9-071ca71a8c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:01:06.344216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d4151-c88a-4d85-8ec9-071ca71a8c8c service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:01:06.354476 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1445/2891] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:01:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:01:16.185000 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795edf9a-026c-4008-8ae4-2553e301ce01 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:01:16.195849 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795edf9a-026c-4008-8ae4-2553e301ce01 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:01:16.201030 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1a31-ea31-4c93-933a-7f1303ed65e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:01:16.201671 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1a31-ea31-4c93-933a-7f1303ed65e1 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:01:16.201978 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1a31-ea31-4c93-933a-7f1303ed65e1 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:01:16.202291 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1a31-ea31-4c93-933a-7f1303ed65e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:01:16.204057 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9c7b1a31-ea31-4c93-933a-7f1303ed65e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:01:16.216128 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b1a31-ea31-4c93-933a-7f1303ed65e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:01:16.217729 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b1a31-ea31-4c93-933a-7f1303ed65e1 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:01:16.227446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1447/2892] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:01:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:01:39.190119 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6b29-607c-4b7c-97da-5d68148c2ca2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:01:39.190650 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6b29-607c-4b7c-97da-5d68148c2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:01:39.190762 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6b29-607c-4b7c-97da-5d68148c2ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:01:39.209925 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-05ac6b29-607c-4b7c-97da-5d68148c2ca2 None None] MFA Rules not processed for user `3df48c5aad0f4cb5aeb7c76d82ab0b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:01:39.211180 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-05ac6b29-607c-4b7c-97da-5d68148c2ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:01:39.279254 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1446/2893] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:01:39.582587 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1a31-ea31-4c93-933a-7f1303ed65e1 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:01:39.592051 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1a31-ea31-4c93-933a-7f1303ed65e1 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:01:39.595670 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:01:39.596298 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:01:39.596582 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:01:39.596882 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:01:39.598658 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:01:39.608628 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:01:39.610077 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:01:39.618387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1448/2894] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:01:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:01:55.755689 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac6b29-607c-4b7c-97da-5d68148c2ca2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:01:55.765261 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac6b29-607c-4b7c-97da-5d68148c2ca2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:01:55.768881 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8491e3-68d5-462c-ae29-8fa9fe77dcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:01:55.769514 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8491e3-68d5-462c-ae29-8fa9fe77dcdb service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:01:55.769800 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8491e3-68d5-462c-ae29-8fa9fe77dcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:01:55.770104 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8491e3-68d5-462c-ae29-8fa9fe77dcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:01:55.772552 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7e8491e3-68d5-462c-ae29-8fa9fe77dcdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:01:55.785537 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8491e3-68d5-462c-ae29-8fa9fe77dcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:01:55.787678 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8491e3-68d5-462c-ae29-8fa9fe77dcdb service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:01:55.798369 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1447/2895] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:01:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:02:11.840406 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:02:11.841842 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:02:11.857507 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef96167-b228-47b9-882f-f29b9edc254e service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:02:11.862867 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f0cad-a284-4a89-95b2-a7df74bab2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:02:11.863502 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f0cad-a284-4a89-95b2-a7df74bab2e2 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:02:11.863782 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f0cad-a284-4a89-95b2-a7df74bab2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:02:11.864054 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f0cad-a284-4a89-95b2-a7df74bab2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:02:11.865777 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a44f0cad-a284-4a89-95b2-a7df74bab2e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:02:11.877624 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f0cad-a284-4a89-95b2-a7df74bab2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:02:11.879733 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f0cad-a284-4a89-95b2-a7df74bab2e2 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:02:11.890933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1449/2896] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:02:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:02:12.985991 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c17aa-0cad-45c4-a0de-88edae5c2226 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:02:12.986513 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c17aa-0cad-45c4-a0de-88edae5c2226 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:02:12.986615 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c17aa-0cad-45c4-a0de-88edae5c2226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:02:13.005216 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f23c17aa-0cad-45c4-a0de-88edae5c2226 None None] MFA Rules not processed for user `67020a523bd14f3689b3349492c90337`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:02:13.006496 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f23c17aa-0cad-45c4-a0de-88edae5c2226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:02:13.013456 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1448/2897] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:02:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:03:15.025202 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f0cad-a284-4a89-95b2-a7df74bab2e2 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:03:15.036420 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f0cad-a284-4a89-95b2-a7df74bab2e2 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:03:15.041393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:03:15.042322 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:03:15.042604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:03:15.042880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] PATH_INFO: `/v3/users/67020a523bd14f3689b3349492c90337` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:03:15.044078 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67020a523bd14f3689b3349492c90337)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:03:15.046021 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:03:15.091735 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67020a523bd14f3689b3349492c90337'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.102692 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67020a523bd14f3689b3349492c90337'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.103397 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67020a523bd14f3689b3349492c90337'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.104022 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67020a523bd14f3689b3349492c90337'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.110970 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67020a523bd14f3689b3349492c90337'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.123310 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1450/2898] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:03:15 2022] DELETE /identity/v3/users/67020a523bd14f3689b3349492c90337 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:03:15.292644 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c17aa-0cad-45c4-a0de-88edae5c2226 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:03:15.305041 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c17aa-0cad-45c4-a0de-88edae5c2226 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:03:15.360319 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:03:15.361176 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:03:15.361455 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:03:15.361734 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] PATH_INFO: `/v3/projects/e2d2f895d6cb4e218216aa316538d046` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:03:15.362953 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d2f895d6cb4e218216aa316538d046)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:03:15.364841 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:03:15.408640 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d2f895d6cb4e218216aa316538d046', 'request_id': 'req-343ae908-1508-4b0f-ae2d-342bc2c7260b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.414456 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d2f895d6cb4e218216aa316538d046', 'request_id': 'req-343ae908-1508-4b0f-ae2d-342bc2c7260b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.421154 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d2f895d6cb4e218216aa316538d046', 'request_id': 'req-343ae908-1508-4b0f-ae2d-342bc2c7260b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.430815 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] The token cache is being invalidate because project e2d2f895d6cb4e218216aa316538d046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:03:15.431101 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.431707 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:03:15.433197 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1449/2899] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:03:15 2022] DELETE /identity/v3/projects/e2d2f895d6cb4e218216aa316538d046 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:04:13.873898 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:04:13.875436 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:13.930194 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18acd2e-7f80-4355-892a-8e81336db91d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:04:13.975011 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4831fe6-16ce-4698-91cf-994998629c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:04:13.975651 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831fe6-16ce-4698-91cf-994998629c4f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:04:13.975933 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831fe6-16ce-4698-91cf-994998629c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:04:13.976208 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831fe6-16ce-4698-91cf-994998629c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:04:13.977953 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c4831fe6-16ce-4698-91cf-994998629c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:13.987187 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4831fe6-16ce-4698-91cf-994998629c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:04:13.988601 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4831fe6-16ce-4698-91cf-994998629c4f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:04:13.996871 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1451/2900] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:04:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:04:18.032741 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:04:18.034213 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:18.091757 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ae908-1508-4b0f-ae2d-342bc2c7260b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:04:18.095405 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3196743ff7564c16b3cfdae4f0008075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:04:18.096343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:04:18.096343 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:04:18.096575 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:04:18.098409 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:18.156645 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:04:18.158415 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:04:18.168711 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1450/2901] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:04:28.080931 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d17df-9ce7-45f3-bb4d-462246ad415b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:04:28.081466 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d17df-9ce7-45f3-bb4d-462246ad415b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:04:28.081593 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d17df-9ce7-45f3-bb4d-462246ad415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:04:28.098061 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-700d17df-9ce7-45f3-bb4d-462246ad415b None None] MFA Rules not processed for user `3df48c5aad0f4cb5aeb7c76d82ab0b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:04:28.099268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-700d17df-9ce7-45f3-bb4d-462246ad415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:28.106180 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1452/2902] 10.222.0.75 () {58 vars in 957 bytes} [Tue May 17 16:04:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 16:04:28.850412 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:04:28.851910 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:28.863437 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba3ec2-fbad-4372-91f5-793456cde866 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:04:28.867520 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156afa-78c4-4649-917d-ba8fda8ce2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:04:28.868152 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156afa-78c4-4649-917d-ba8fda8ce2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:04:28.868436 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156afa-78c4-4649-917d-ba8fda8ce2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:04:28.868708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156afa-78c4-4649-917d-ba8fda8ce2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:04:28.870542 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d2156afa-78c4-4649-917d-ba8fda8ce2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:28.940897 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156afa-78c4-4649-917d-ba8fda8ce2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:04:28.942429 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156afa-78c4-4649-917d-ba8fda8ce2f0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:04:28.954234 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1451/2903] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:04:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:04:31.381527 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d17df-9ce7-45f3-bb4d-462246ad415b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:04:31.383703 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-700d17df-9ce7-45f3-bb4d-462246ad415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:31.411896 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d17df-9ce7-45f3-bb4d-462246ad415b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:04:31.421320 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef90c1c9c784d8792b3afe6e8e7fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:04:31.422016 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:04:31.422309 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:04:31.422588 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:04:31.424655 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:31.439393 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:04:31.441181 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:04:31.467516 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1453/2904] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:04:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:04:44.425420 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156afa-78c4-4649-917d-ba8fda8ce2f0 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:04:44.465725 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156afa-78c4-4649-917d-ba8fda8ce2f0 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:04:44.469396 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb8aca-1662-40aa-934f-436036f8c283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:04:44.470070 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb8aca-1662-40aa-934f-436036f8c283 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:04:44.470358 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb8aca-1662-40aa-934f-436036f8c283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:04:44.470634 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb8aca-1662-40aa-934f-436036f8c283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:04:44.472435 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-56bb8aca-1662-40aa-934f-436036f8c283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:04:44.566271 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb8aca-1662-40aa-934f-436036f8c283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:04:44.567708 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb8aca-1662-40aa-934f-436036f8c283 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:04:44.577288 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1452/2905] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:04:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:06:21.119792 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:06:21.121230 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:06:21.251387 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac6364-b93e-4f11-b0e2-fee0dc01e75b service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:06:21.256405 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:06:21.257040 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:06:21.257319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:06:21.257592 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:06:21.259352 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:06:21.270448 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:06:21.272010 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:06:21.282075 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1454/2906] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:06:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 16:06:48.238906 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb8aca-1662-40aa-934f-436036f8c283 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:06:48.249002 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb8aca-1662-40aa-934f-436036f8c283 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:06:48.252590 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79445e4-e320-4e00-9912-d8ab25dc4c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e9f522282644e2aad2eefba7509f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:06:48.253219 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79445e4-e320-4e00-9912-d8ab25dc4c5d service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:06:48.253500 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79445e4-e320-4e00-9912-d8ab25dc4c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:06:48.253770 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79445e4-e320-4e00-9912-d8ab25dc4c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:06:48.255659 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a79445e4-e320-4e00-9912-d8ab25dc4c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:06:48.337703 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79445e4-e320-4e00-9912-d8ab25dc4c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:06:48.339106 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79445e4-e320-4e00-9912-d8ab25dc4c5d service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:06:48.357674 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1453/2907] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 16:06:54.178529 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:06:54.180317 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:06:54.195361 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e30bf-8875-4c84-9498-d6f389d402a8 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:06:54.199546 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:06:54.200446 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:06:54.200880 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:06:54.201163 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] PATH_INFO: `/v3/users/3df48c5aad0f4cb5aeb7c76d82ab0b4b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:06:54.202425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df48c5aad0f4cb5aeb7c76d82ab0b4b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:06:54.204363 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:06:54.254537 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df48c5aad0f4cb5aeb7c76d82ab0b4b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.265958 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df48c5aad0f4cb5aeb7c76d82ab0b4b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.266649 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df48c5aad0f4cb5aeb7c76d82ab0b4b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.267253 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df48c5aad0f4cb5aeb7c76d82ab0b4b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.274339 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df48c5aad0f4cb5aeb7c76d82ab0b4b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.288974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1455/2908] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:06:54 2022] DELETE /identity/v3/users/3df48c5aad0f4cb5aeb7c76d82ab0b4b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:06:54.453392 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79445e4-e320-4e00-9912-d8ab25dc4c5d service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:06:54.467242 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79445e4-e320-4e00-9912-d8ab25dc4c5d service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:06:54.523416 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:06:54.524246 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:06:54.524529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:06:54.524805 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] PATH_INFO: `/v3/projects/fbe368679f4c4d968619ea0e2456c407` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:06:54.525971 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe368679f4c4d968619ea0e2456c407)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:06:54.528559 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:06:54.574756 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe368679f4c4d968619ea0e2456c407', 'request_id': 'req-9d987d3b-80e1-443d-8a5f-dbf073d1862b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.580777 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe368679f4c4d968619ea0e2456c407', 'request_id': 'req-9d987d3b-80e1-443d-8a5f-dbf073d1862b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.587732 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe368679f4c4d968619ea0e2456c407', 'request_id': 'req-9d987d3b-80e1-443d-8a5f-dbf073d1862b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.598221 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] The token cache is being invalidate because project fbe368679f4c4d968619ea0e2456c407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:06:54.598529 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.599135 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.600663 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1454/2909] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:06:54 2022] DELETE /identity/v3/projects/fbe368679f4c4d968619ea0e2456c407 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:06:54.604633 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:06:54.606029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:06:54.618795 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac115c-d3c4-4575-bc80-6136ba8cf773 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:06:54.671690 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:06:54.672547 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:06:54.672825 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:06:54.673098 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] PATH_INFO: `/v3/users/b46cc9c6d3334842b68dcda52e4ceaec` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:06:54.674288 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46cc9c6d3334842b68dcda52e4ceaec)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:06:54.676190 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:06:54.719801 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46cc9c6d3334842b68dcda52e4ceaec'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.731324 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46cc9c6d3334842b68dcda52e4ceaec'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.731979 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46cc9c6d3334842b68dcda52e4ceaec'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.732565 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46cc9c6d3334842b68dcda52e4ceaec'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.739268 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46cc9c6d3334842b68dcda52e4ceaec'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:54.751425 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1456/2910] 10.222.0.75 () {58 vars in 1223 bytes} [Tue May 17 16:06:54 2022] DELETE /identity/v3/users/b46cc9c6d3334842b68dcda52e4ceaec => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:06:54.918787 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:06:54.920280 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:06:54.932861 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d987d3b-80e1-443d-8a5f-dbf073d1862b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:06:54.990584 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee5e213008a431f98430b648aa9d659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '519a641cdee343408fe589d891a54066', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:06:54.991380 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:06:54.991665 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:06:54.991943 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] PATH_INFO: `/v3/projects/aa2522a5f92c4818bd9129ed97f5e6bb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:06:54.993117 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2522a5f92c4818bd9129ed97f5e6bb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:06:54.995082 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:06:55.042366 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2522a5f92c4818bd9129ed97f5e6bb', 'request_id': 'req-e8f48894-65e0-4927-b5cc-fa7d1fabe697'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:55.048457 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2522a5f92c4818bd9129ed97f5e6bb', 'request_id': 'req-e8f48894-65e0-4927-b5cc-fa7d1fabe697'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:55.055297 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2522a5f92c4818bd9129ed97f5e6bb', 'request_id': 'req-e8f48894-65e0-4927-b5cc-fa7d1fabe697'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:55.064959 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] The token cache is being invalidate because project aa2522a5f92c4818bd9129ed97f5e6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 16:06:55.065240 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:55.065848 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8f48894-65e0-4927-b5cc-fa7d1fabe697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 16:06:55.067491 dv-cinder-842128-1-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1455/2911] 10.222.0.75 () {58 vars in 1232 bytes} [Tue May 17 16:06:54 2022] DELETE /identity/v3/projects/aa2522a5f92c4818bd9129ed97f5e6bb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:11:29.091974 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:11:29.094036 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:11:29.161241 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65364ba-97f2-4ca1-abb3-eb88e50681c7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:11:29.216678 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a730e-1891-494b-8ee4-91462c6e3603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8614649160fb4bcca89b18ceeb6c0785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd2781d8d664de3a757901c184962d4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:11:29.217319 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a730e-1891-494b-8ee4-91462c6e3603 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:11:29.217604 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a730e-1891-494b-8ee4-91462c6e3603 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:11:29.217883 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a730e-1891-494b-8ee4-91462c6e3603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:11:29.220416 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7a3a730e-1891-494b-8ee4-91462c6e3603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:11:29.231435 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a730e-1891-494b-8ee4-91462c6e3603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:11:29.233029 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a730e-1891-494b-8ee4-91462c6e3603 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:11:29.243258 dv-cinder-842128-1-iscsi devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1457/2912] 10.222.0.75 () {60 vars in 1365 bytes} [Tue May 17 16:11:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)